Apr 14 04:12:32 user cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73296) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 04:12:32 user cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73296) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 04:12:32 user cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73296) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 04:12:33 user cinder-volume[73296]: INFO dbcounter [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Registered counter for database cinder Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG dbcounter [-] [73296] Writer thread running {{(pid=73296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:12:33 user cinder-volume[73296]: INFO cinder.rpc [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 04:12:33 user cinder-volume[73296]: INFO cinder.rpc [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:12:33 user cinder-volume[73296]: INFO cinder.volume.manager [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Determined volume DB was empty at startup. Apr 14 04:12:33 user cinder-volume[73296]: DEBUG cinder.volume.manager [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73296) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Apr 14 04:12:33 user cinder-volume[73296]: INFO cinder.volume.manager [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 04:12:33 user cinder-volume[73296]: WARNING stevedore.named [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 04:12:33 user cinder-volume[73296]: WARNING castellan.key_manager [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 04:12:33 user cinder-volume[73296]: WARNING cinder.keymgr.conf_key_mgr [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:12:33 user cinder-volume[73296]: INFO cinder.rpc [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 14 04:12:33 user cinder-volume[73296]: INFO cinder.rpc [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Apr 14 04:12:33 user cinder-volume[73296]: WARNING stevedore.named [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 04:12:33 user cinder-volume[73296]: WARNING castellan.key_manager [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 04:12:33 user cinder-volume[73296]: INFO cinder.volume.manager [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Image-volume cache enabled for host user@joviandss-2. Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:12:33 user cinder-volume[73296]: INFO oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Starting 1 workers Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Started child 73393 {{(pid=73296) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Full set of CONF: {{(pid=73296) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] ******************************************************************************** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] Configuration options gathered from: {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] ================================================================================ {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] allow_availability_zone_fallback = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] allow_compression_on_image_upload = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] allowed_direct_url_schemes = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] api_rate_limit = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] auth_strategy = keystone {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] az_cache_duration = 3600 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_availability_zone = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_host = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_stats_polling_interval = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backup_api_class = cinder.backup.api.API {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backup_name_template = backup-%s {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backup_use_same_host = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backup_use_temp_snapshot = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] chap_password = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] chap_password_len = 12 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] chap_username = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_internal_tenant_project_id = 447e3d081a064aac847d4d452695f22d {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_internal_tenant_user_id = fc901f66436b4abcbb0fc81fe6d645c2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cloned_volume_same_az = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73393]: INFO cinder.service [-] Starting cinder-volume node (version 22.1.0) Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cluster = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] compression_format = gzip {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] compute_api_class = cinder.compute.nova.API {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] config_dir = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] config_source = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] control_exchange = openstack {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] debug = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] default_availability_zone = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] default_group_type = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] default_volume_type = joviandss-2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] driver_client_cert = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] driver_client_cert_key = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] driver_data_namespace = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] driver_ssl_cert_path = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] driver_ssl_cert_verify = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] driver_use_ssl = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] enable_force_upload = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] enable_new_services = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] enable_unsupported_driver = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] enabled_backends = ['joviandss-2'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] enforce_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] filter_function = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_api_insecure = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_api_servers = ['http://10.0.0.210/image'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_api_ssl_compression = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_ca_certificates_file = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_catalog_info = image:glance:publicURL {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_certfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_keyfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_num_retries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] glance_request_timeout = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] goodness_function = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] graceful_shutdown_timeout = 5 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] group_api_class = cinder.group.api.API {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] host = user {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iet_conf = /etc/iet/ietd.conf {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_compress_on_upload = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_conversion_address_space_limit = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_conversion_cpu_limit = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_conversion_disable = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_upload_use_cinder_backend = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_upload_use_internal_tenant = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_volume_cache_enabled = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_volume_cache_max_count = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] image_volume_cache_max_size_gb = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] init_host_max_objects_retrieval = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] instance_format = [instance: %(uuid)s] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iscsi_iotype = fileio {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iscsi_target_flags = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iscsi_write_cache = on {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iser_helper = tgtadm {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iser_ip_address = 10.0.0.210 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iser_port = 3260 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] jovian_block_size = 64K {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] jovian_ignore_tpath = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] jovian_pool = Pool-0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] jovian_recovery_delay = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_config_append = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_dir = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_file = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_options = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_rotate_interval = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_rotate_interval_type = days {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] log_rotation_type = none {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] max_age = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] max_logfile_count = 30 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] max_logfile_size_mb = 200 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] max_over_subscription_ratio = 20.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] message_reap_interval = 86400 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] message_ttl = 2592000 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] migration_create_volume_timeout_secs = 300 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] monkey_patch = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] monkey_patch_modules = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] my_ip = 10.0.0.210 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] no_snapshot_gb_quota = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] num_iser_scan_tries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] num_shell_tries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] num_volume_device_scan_tries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] nvmeof_conn_info_version = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] nvmet_ns_id = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] nvmet_port_id = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] osapi_max_limit = 1000 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] osapi_volume_ext_list = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] osapi_volume_listen_port = 8776 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] osapi_volume_use_ssl = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] osapi_volume_workers = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] per_volume_size_limit = -1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] periodic_fuzzy_delay = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] periodic_interval = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] public_endpoint = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] publish_errors = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_backup_gigabytes = 1000 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_backups = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_consistencygroups = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_gigabytes = 1000 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Starting volume driver JovianISCSIDriver (1.0.2) Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_groups = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_snapshots = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] quota_volumes = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] rate_limit_burst = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] rate_limit_except_level = CRITICAL {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] rate_limit_interval = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] reinit_driver_count = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] replication_device = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] report_discard_supported = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] report_interval = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] reservation_clean_interval = 86400 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] reservation_expire = 86400 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] reserved_image_namespaces = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] check pool {{(pid=73393) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] reserved_percentage = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] rpc_response_timeout = 120 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] run_external_periodic_tasks = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] san_hosts = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] scst_target_driver = iscsi {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] scst_target_iqn_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_down_time = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] snapshot_name_template = snapshot-%s {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] snapshot_same_host = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] split_loggers = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] ssh_hosts_key_file = /opt/stack/data/cinder/ssh_known_hosts {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] state_path = /opt/stack/data/cinder {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] storage_availability_zone = nova {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] storage_protocol = iSCSI {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] strict_ssh_host_key_policy = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] syslog_log_facility = LOG_USER {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] target_helper = lioadm {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] target_ip_address = 10.0.0.210 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] target_port = 3260 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] target_protocol = iscsi {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] target_secondary_ip_addresses = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] trace_flags = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] transport_url = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] until_refresh = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_chap_auth = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_default_quota_class = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_eventlog = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_journal = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_json = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_stderr = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] use_syslog = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] verify_glance_signatures = enabled {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_api_class = cinder.volume.api.API {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_backend_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_clear = zero {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_clear_ionice = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_clear_size = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_copy_bps_limit = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_dd_blocksize = 1M {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_name_template = volume-%s {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_service_inithost_offload = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volume_usage_audit_period = month {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] watch_log_file = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] zoning_mode = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_concurrency.disable_process_locking = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.admin_password = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.admin_token = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.admin_user = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_port = 35357 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_protocol = https {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_section = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_type = password {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_uri = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.auth_version = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.cache = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.certfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.identity_uri = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.include_service_catalog = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.insecure = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.interface = public {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.keyfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.region_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.service_type = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.backend = dogpile.cache.null {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.backend_argument = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.config_prefix = cache.oslo {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.dead_timeout = 60.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.debug_cache_backend = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.enable_retry_client = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.enable_socket_keepalive = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.enabled = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.expiration_time = 600 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.hashclient_retry_attempts = 2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.hashclient_retry_delay = 1.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_dead_retry = 300 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_password = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_pool_maxsize = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_sasl_enabled = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_socket_timeout = 1.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.memcache_username = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.proxies = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.retry_attempts = 2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.retry_delay = 0.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.socket_keepalive_count = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.socket_keepalive_idle = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.socket_keepalive_interval = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.tls_allowed_ciphers = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.tls_cafile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.tls_certfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.tls_enabled = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cache.tls_keyfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] coordination.backend_url = etcd3+http://10.0.0.210:2379 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.backend = sqlalchemy {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.connection = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.connection_debug = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.connection_parameters = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.connection_recycle_time = 3600 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.connection_trace = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.db_inc_retry_interval = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.db_max_retries = 20 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.db_max_retry_interval = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.db_retry_interval = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.max_overflow = 50 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.max_pool_size = 5 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.max_retries = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.mysql_enable_ndb = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.mysql_wsrep_sync_wait = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.pool_timeout = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.retry_interval = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.slave_connection = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.sqlite_synchronous = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] database.use_db_reconnect = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.enforce_new_defaults = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.enforce_scope = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.policy_default_rule = default {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.policy_file = policy.yaml {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.connection_string = messaging:// {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.enabled = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.es_doc_type = notification {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.es_scroll_size = 10000 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.es_scroll_time = 2m {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.filter_error_trace = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.hmac_keys = SECRET_KEY {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.sentinel_service_name = mymaster {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.socket_timeout = 0.1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] profiler.trace_sqlalchemy = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] privsep_osbrick.capabilities = [21] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] privsep_osbrick.group = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] privsep_osbrick.helper_command = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] privsep_osbrick.user = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_sys_admin.group = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_sys_admin.helper_command = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_sys_admin.thread_pool_size = 12 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] cinder_sys_admin.user = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.auth_section = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.auth_type = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.cafile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.certfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.collect_timing = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.insecure = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.keyfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.send_service_user_token = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.split_loggers = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] service_user.timeout = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.backend_availability_zone = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.chap_password = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.chap_username = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.driver_client_cert = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.driver_client_cert_key = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.driver_data_namespace = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.driver_use_ssl = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.extra_capabilities = {} {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.filter_function = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.goodness_function = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iscsi_iotype = fileio {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iscsi_target_flags = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iscsi_write_cache = on {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iser_helper = tgtadm {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iser_ip_address = 10.0.0.210 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iser_port = 3260 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.num_shell_tries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.replication_device = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.report_discard_supported = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.reserved_percentage = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_api_port = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_clustername = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_ip = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_is_local = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_login = admin {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_password = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_private_key = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_ssh_port = 22 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.san_thin_provision = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.ssh_conn_timeout = 30 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.ssh_max_pool_conn = 5 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.ssh_min_pool_conn = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.target_helper = tgtadm {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.target_ip_address = 10.0.0.210 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.target_port = 3260 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.target_protocol = iscsi {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.trace_flags = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.unique_fqdn_network = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.use_chap_auth = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_backend_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_clear = zero {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_clear_ionice = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_clear_size = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_reports.file_event_handler = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_reports.log_dir = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.backend_availability_zone = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.backend_host = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.backend_native_threads_pool_size = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.backup_use_temp_snapshot = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.chap_password = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.chap_username = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.chiscsi_conf = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.driver_client_cert = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.driver_client_cert_key = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.driver_data_namespace = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.driver_ssl_cert_path = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.driver_ssl_cert_verify = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.driver_use_ssl = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.enable_unsupported_driver = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.enforce_multipath_for_image_xfer = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.extra_capabilities = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.filter_function = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.goodness_function = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iet_conf = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.image_upload_use_cinder_backend = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.image_upload_use_internal_tenant = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.image_volume_cache_enabled = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.image_volume_cache_max_count = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.image_volume_cache_max_size_gb = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iscsi_iotype = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iscsi_target_flags = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iscsi_write_cache = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iser_helper = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iser_ip_address = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iser_port = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.iser_target_prefix = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.max_over_subscription_ratio = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.num_iser_scan_tries = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.num_shell_tries = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.num_volume_device_scan_tries = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.nvmeof_conn_info_version = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.nvmet_ns_id = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.nvmet_port_id = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.replication_device = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.report_discard_supported = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.reserved_percentage = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.scst_target_driver = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.scst_target_iqn_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.storage_protocol = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.suppress_requests_ssl_warnings = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.target_helper = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.target_ip_address = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.target_port = 3260 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.target_prefix = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.target_protocol = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.target_secondary_ip_addresses = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.trace_flags = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.unique_fqdn_network = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.use_chap_auth = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.use_multipath_for_image_xfer = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_backend_name = joviandss-2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_clear = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_clear_ionice = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_clear_size = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_copy_blkio_cgroup_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_copy_bps_limit = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_dd_blocksize = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volume_driver = cinder.volume.drivers.open_e.iscsi.JovianISCSIDriver {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] joviandss-2.volumes_dir = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.ssl = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_notifications.driver = [] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_notifications.retry = -1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] key_manager.fixed_key = **** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.barbican_api_version = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.barbican_endpoint = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.barbican_endpoint_type = public {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.barbican_region_name = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.cafile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.certfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.collect_timing = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.insecure = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.keyfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.number_of_retries = 60 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.retry_delay = 1 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.send_service_user_token = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.split_loggers = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.timeout = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.verify_ssl = True {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican.verify_ssl_path = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.auth_section = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.auth_type = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.cafile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.certfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.collect_timing = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.insecure = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.keyfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.split_loggers = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] barbican_service_user.timeout = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.approle_role_id = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.approle_secret_id = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.cafile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.certfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.collect_timing = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.insecure = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.keyfile = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.kv_mountpoint = secret {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.kv_version = 2 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.namespace = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.root_token_id = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.split_loggers = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.ssl_ca_crt_file = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.timeout = None {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.use_ssl = False {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:12:33 user cinder-volume[73296]: DEBUG oslo_service.service [None req-73a5de3f-4620-4797-86ca-66a19f393a05 None None] ******************************************************************************** {{(pid=73296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 04:12:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276212736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:12:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] check pool {{(pid=73393) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 04:12:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:12:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276212736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276212736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:12:35 user cinder-volume[73393]: INFO cinder.volume.driver [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Driver hasn't implemented _init_vendor_properties() Apr 14 04:12:35 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Initialized capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73393) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:832}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG oslo_db.sqlalchemy.engines [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73393) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writer thread running {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.db.sqlalchemy.api [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Building query based on filter {{(pid=73393) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73393) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1146}} Apr 14 04:12:36 user cinder-volume[73393]: INFO cinder.keymgr.migration [None req-1ac278bf-c149-45d6-b65e-c0cd0af59ee8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276225024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.manager [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:12:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Driver initialization completed successfully. Apr 14 04:12:36 user cinder-volume[73393]: INFO cinder.manager [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Initiating service 2 cleanup Apr 14 04:12:36 user cinder-volume[73393]: INFO cinder.manager [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Service 2 cleanup completed. Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.service [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Creating RPC server for service cinder-volume {{(pid=73393) start /opt/stack/cinder/cinder/service.py:238}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.service [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73393) start /opt/stack/cinder/cinder/service.py:244}} Apr 14 04:12:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Initializing RPC dependent components of volume driver JovianISCSIDriver (1.0.2) Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:12:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:12:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276225024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:12:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:12:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0c39e3cc-014a-4bcd-a67f-de8b8a3a57e9 None None] Driver post RPC initialization completed successfully. Apr 14 04:12:43 user cinder-volume[73296]: DEBUG dbcounter [-] [73296] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=73296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=24,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:13:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:13:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:13:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:14:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:14:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:14:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:14:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:14:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:14:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:14:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:14:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276225024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:14:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:14:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:14:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:14:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:15:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:15:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:15:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:15:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:15:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:15:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:15:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:15:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276212736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:15:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:15:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:15:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:15:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Flow 'volume_create_manager' (f56f040f-8a08-45cc-9cc9-5967b5650fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db67c051-f628-4b24-8c19-c19fbaecc738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db67c051-f628-4b24-8c19-c19fbaecc738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-441870937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=592547ad-a107-4cca-b4b4-db1df5964f37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4608d40db51487693e2939916b28131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:10Z,use_quota=True,user_id='2e7a9a4459884ab0b9f4394013560054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f592c366-7a78-4680-a94a-558b5f167333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f592c366-7a78-4680-a94a-558b5f167333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1bd695-5e76-4087-ac27-4c3b70d3fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1bd695-5e76-4087-ac27-4c3b70d3fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592547ad-a107-4cca-b4b4-db1df5964f37', 'volume_name': 'volume-592547ad-a107-4cca-b4b4-db1df5964f37', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57159107-d785-4462-81eb-e7fc8811bb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57159107-d785-4462-81eb-e7fc8811bb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759e6e6c-1934-44b7-bf2b-d7e45037b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:10 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Volume 592547ad-a107-4cca-b4b4-db1df5964f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592547ad-a107-4cca-b4b4-db1df5964f37', 'volume_size': 1} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] creating volume v_592547ad-a107-4cca-b4b4-db1df5964f37. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] create volume {'name': 'v_592547ad-a107-4cca-b4b4-db1df5964f37', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_592547ad-a107-4cca-b4b4-db1df5964f37', 'is_clone': False, 'name': 'v_592547ad-a107-4cca-b4b4-db1df5964f37'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759e6e6c-1934-44b7-bf2b-d7e45037b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592547ad-a107-4cca-b4b4-db1df5964f37', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc00d30-3aba-4f92-978d-94559d2bca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:11 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Volume volume-592547ad-a107-4cca-b4b4-db1df5964f37 (592547ad-a107-4cca-b4b4-db1df5964f37): created successfully Apr 14 04:16:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc00d30-3aba-4f92-978d-94559d2bca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Flow 'volume_create_manager' (f56f040f-8a08-45cc-9cc9-5967b5650fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:11 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a5630c1d-7f4c-4b9f-9a03-6d5a7ae25dc5 tempest-VolumesTestJSON-1547245948 None] Created volume successfully. Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Flow 'volume_create_manager' (10537ee3-8ded-47d0-982d-22c6233b4d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8507a1-b6e3-4cc8-988e-76791667655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8507a1-b6e3-4cc8-988e-76791667655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1325878880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=006d9258-df4b-41b8-80a3-b57ea869fc53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4608d40db51487693e2939916b28131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:13Z,use_quota=True,user_id='2e7a9a4459884ab0b9f4394013560054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6fc52-0ff0-40f3-805c-71976d84082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6fc52-0ff0-40f3-805c-71976d84082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2dd739-c41d-4295-bbff-d2e8beadcff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2dd739-c41d-4295-bbff-d2e8beadcff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006d9258-df4b-41b8-80a3-b57ea869fc53', 'volume_name': 'volume-006d9258-df4b-41b8-80a3-b57ea869fc53', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89547bf9-028a-4e03-a5a2-e99c2f494a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89547bf9-028a-4e03-a5a2-e99c2f494a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3530c022-e697-4557-b3d0-7c5f2cf0791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Volume 006d9258-df4b-41b8-80a3-b57ea869fc53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006d9258-df4b-41b8-80a3-b57ea869fc53', 'volume_size': 1} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] creating volume v_006d9258-df4b-41b8-80a3-b57ea869fc53. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] create volume {'name': 'v_006d9258-df4b-41b8-80a3-b57ea869fc53', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_006d9258-df4b-41b8-80a3-b57ea869fc53', 'is_clone': False, 'name': 'v_006d9258-df4b-41b8-80a3-b57ea869fc53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3530c022-e697-4557-b3d0-7c5f2cf0791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006d9258-df4b-41b8-80a3-b57ea869fc53', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ba3681-19f4-4b0a-ba48-dc4f8bedcc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:14 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Volume volume-006d9258-df4b-41b8-80a3-b57ea869fc53 (006d9258-df4b-41b8-80a3-b57ea869fc53): created successfully Apr 14 04:16:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ba3681-19f4-4b0a-ba48-dc4f8bedcc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Flow 'volume_create_manager' (10537ee3-8ded-47d0-982d-22c6233b4d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-bf7d1bc7-efdc-4633-bf1c-debb7a73235f tempest-VolumesTestJSON-1547245948 None] Created volume successfully. Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Flow 'volume_create_manager' (43231398-f169-4164-9894-217b75da92a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59f2a6f-1355-4031-887e-ad8f11997678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59f2a6f-1355-4031-887e-ad8f11997678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1257835085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=393464b8-923a-4f32-a9c6-3f1b6b5e0b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4608d40db51487693e2939916b28131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:16Z,use_quota=True,user_id='2e7a9a4459884ab0b9f4394013560054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579bcc29-578c-47cc-88d6-b8f425112733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579bcc29-578c-47cc-88d6-b8f425112733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19bbcac-936b-4647-8564-daaaff0370ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19bbcac-936b-4647-8564-daaaff0370ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'volume_name': 'volume-393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b3476a-a1c3-4b98-827d-fa8913493cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b3476a-a1c3-4b98-827d-fa8913493cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ea1eac-211e-4910-969c-fa0d915faf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:15 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Volume 393464b8-923a-4f32-a9c6-3f1b6b5e0b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'volume_size': 1} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] creating volume v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] create volume {'name': 'v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'is_clone': False, 'name': 'v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ea1eac-211e-4910-969c-fa0d915faf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4736d90d-8bd2-4676-a535-40b4fc9c6955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Volume volume-393464b8-923a-4f32-a9c6-3f1b6b5e0b53 (393464b8-923a-4f32-a9c6-3f1b6b5e0b53): created successfully Apr 14 04:16:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4736d90d-8bd2-4676-a535-40b4fc9c6955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Flow 'volume_create_manager' (43231398-f169-4164-9894-217b75da92a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f80e59cf-7730-474c-801b-72f96ae84cf1 tempest-VolumesTestJSON-1547245948 None] Created volume successfully. Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Flow 'volume_create_manager' (978a8af4-93c5-4b0d-bcba-59263422d56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b702797-dc1f-4899-83ec-92181db701f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b702797-dc1f-4899-83ec-92181db701f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355191391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=16203803-41c1-4da7-804c-d344751cb449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280aa55745a749b7baa134334d25c9c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:18Z,use_quota=True,user_id='6e422970cd8340bf996a135088094f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c8e80a-faa8-4f50-9e63-c2694bd811d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c8e80a-faa8-4f50-9e63-c2694bd811d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a24ed0-5883-4cc8-a0d6-47567bbd2007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a24ed0-5883-4cc8-a0d6-47567bbd2007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16203803-41c1-4da7-804c-d344751cb449', 'volume_name': 'volume-16203803-41c1-4da7-804c-d344751cb449', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b4a9de-aa06-4431-8a6e-f883780967f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b4a9de-aa06-4431-8a6e-f883780967f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7208ecb-c47b-452d-ac2a-68b30ea5e223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:18 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Volume 16203803-41c1-4da7-804c-d344751cb449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16203803-41c1-4da7-804c-d344751cb449', 'volume_size': 1} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] creating volume v_16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] create volume {'name': 'v_16203803-41c1-4da7-804c-d344751cb449', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Acquiring lock "cinder-393464b8-923a-4f32-a9c6-3f1b6b5e0b53-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Lock "cinder-393464b8-923a-4f32-a9c6-3f1b6b5e0b53-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] remove_export for volume: 393464b8-923a-4f32-a9c6-3f1b6b5e0b53. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1257835085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=393464b8-923a-4f32-a9c6-3f1b6b5e0b53,launched_at=2023-04-14T04:16:17Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4608d40db51487693e2939916b28131',provider_auth='CHAP KiSxHnDa CdIw79vhmKbsuj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:16Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:16:19Z,updated_at=2023-04-14T04:16:19Z,use_quota=True,user_id='2e7a9a4459884ab0b9f4394013560054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] detach volume v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 from target iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53/luns/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53/luns/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53/luns/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53/luns/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] failed to remove resource iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 because of JDSS resource v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] delete target: iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] delete target iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] failed to remove resource iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 because of JDSS resource iqn.2010-10.org.openstack:393464b8-923a-4f32-a9c6-3f1b6b5e0b53 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] deleating volume v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] get snapshots for volume v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_16203803-41c1-4da7-804c-d344751cb449', 'is_clone': False, 'name': 'v_16203803-41c1-4da7-804c-d344751cb449'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7208ecb-c47b-452d-ac2a-68b30ea5e223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16203803-41c1-4da7-804c-d344751cb449', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0aecf2-f169-40e4-89b7-98455428b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:19 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Volume volume-16203803-41c1-4da7-804c-d344751cb449 (16203803-41c1-4da7-804c-d344751cb449): created successfully Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0aecf2-f169-40e4-89b7-98455428b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Flow 'volume_create_manager' (978a8af4-93c5-4b0d-bcba-59263422d56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:19 user cinder-volume[73393]: INFO cinder.volume.manager [None req-97d6ef5c-ca36-4a3f-b354-efbb46e8aba5 tempest-VolumesActionsTest-447148503 None] Created volume successfully. Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] get volume v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447185', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114764', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12129710122461482337', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a971206c94859ae3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275897344', 'san:volume_id': 'a971206c94859ae373daa18392f2ddc02426adc6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87095', 'name': 'v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] delete volume:v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] volume v_393464b8-923a-4f32-a9c6-3f1b6b5e0b53 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:16:23 user cinder-volume[73393]: WARNING cinder.quota [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Deprecated: Default quota for resource: volumes_joviandss-2 is set by the default quota flag: quota_volumes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:16:23 user cinder-volume[73393]: WARNING cinder.quota [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Deprecated: Default quota for resource: gigabytes_joviandss-2 is set by the default quota flag: quota_gigabytes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:16:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Created reservations ['94bcb12f-7beb-4611-a634-0f1c14616a93', 'd082207e-e8c7-4970-91e3-bb166fded79a', '88449423-c98b-41f3-9d70-163c6c7c9a16', '88e98390-9642-4e16-b013-2715c481ed66'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:16:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:16:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:16:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Acquiring lock "cinder-006d9258-df4b-41b8-80a3-b57ea869fc53-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Lock "cinder-006d9258-df4b-41b8-80a3-b57ea869fc53-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] remove_export for volume: 006d9258-df4b-41b8-80a3-b57ea869fc53. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1325878880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=006d9258-df4b-41b8-80a3-b57ea869fc53,launched_at=2023-04-14T04:16:14Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4608d40db51487693e2939916b28131',provider_auth='CHAP XApuomwz Xc3ghVOswSRdUx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:13Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:16:24Z,updated_at=2023-04-14T04:16:24Z,use_quota=True,user_id='2e7a9a4459884ab0b9f4394013560054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] detach volume v_006d9258-df4b-41b8-80a3-b57ea869fc53 from target iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53/luns/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53/luns/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53/luns/v_006d9258-df4b-41b8-80a3-b57ea869fc53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53/luns/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] failed to remove resource iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 because of JDSS resource v_006d9258-df4b-41b8-80a3-b57ea869fc53 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] delete target: iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] delete target iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275966976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] failed to remove resource iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 because of JDSS resource iqn.2010-10.org.openstack:006d9258-df4b-41b8-80a3-b57ea869fc53 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] deleating volume v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] get snapshots for volume v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Deleted volume successfully. Apr 14 04:16:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-7a3606bf-94e9-4007-ba24-88be6d9b025f tempest-VolumesTestJSON-1547245948 None] Lock "cinder-393464b8-923a-4f32-a9c6-3f1b6b5e0b53-delete_volume" released by "delete_volume" :: held 5.643s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] get volume v_006d9258-df4b-41b8-80a3-b57ea869fc53 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_006d9258-df4b-41b8-80a3-b57ea869fc53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447182', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114760', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15002599335197448558', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6ef5f353b1d41613', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275966976', 'san:volume_id': '6ef5f353b1d41613b7a4682ccaa82be6155b3119', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87086', 'name': 'v_006d9258-df4b-41b8-80a3-b57ea869fc53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] delete volume:v_006d9258-df4b-41b8-80a3-b57ea869fc53 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114275966976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:16:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_006d9258-df4b-41b8-80a3-b57ea869fc53 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] volume v_006d9258-df4b-41b8-80a3-b57ea869fc53 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.quota [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Created reservations ['83b81b6d-89df-4a97-b8c9-95a6247c1b1e', 'bcd08c33-0973-4ae7-a3e3-ced689551c82', 'a63a760b-05b4-4111-afe2-0082d3170105', '65ac7d0a-ecfc-46ee-9536-6e8560238f03'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Acquiring lock "cinder-592547ad-a107-4cca-b4b4-db1df5964f37-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Lock "cinder-592547ad-a107-4cca-b4b4-db1df5964f37-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] remove_export for volume: 592547ad-a107-4cca-b4b4-db1df5964f37. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-441870937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=592547ad-a107-4cca-b4b4-db1df5964f37,launched_at=2023-04-14T04:16:11Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4608d40db51487693e2939916b28131',provider_auth='CHAP ONJcdeWZ SnDtsP0xNZ38EC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:10Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:16:28Z,updated_at=2023-04-14T04:16:28Z,use_quota=True,user_id='2e7a9a4459884ab0b9f4394013560054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] detach volume v_592547ad-a107-4cca-b4b4-db1df5964f37 from target iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37/luns/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37/luns/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37/luns/v_592547ad-a107-4cca-b4b4-db1df5964f37'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37/luns/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] failed to remove resource iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 because of JDSS resource v_592547ad-a107-4cca-b4b4-db1df5964f37 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] delete target: iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] delete target iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] failed to remove resource iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 because of JDSS resource iqn.2010-10.org.openstack:592547ad-a107-4cca-b4b4-db1df5964f37 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] deleating volume v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] get snapshots for volume v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276073472', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.manager [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:16:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Deleted volume successfully. Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1c483975-c821-424c-a70e-6cc42abe2185 tempest-VolumesTestJSON-1547245948 None] Lock "cinder-006d9258-df4b-41b8-80a3-b57ea869fc53-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] get volume v_592547ad-a107-4cca-b4b4-db1df5964f37 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_592547ad-a107-4cca-b4b4-db1df5964f37', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447179', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114756', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13816235511451189484', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '62a98732a4d6d334', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276073472', 'san:volume_id': '62a98732a4d6d33456cec9b7559a9ef58d9220ba', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86901', 'name': 'v_592547ad-a107-4cca-b4b4-db1df5964f37', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] delete volume:v_592547ad-a107-4cca-b4b4-db1df5964f37 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_592547ad-a107-4cca-b4b4-db1df5964f37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] volume v_592547ad-a107-4cca-b4b4-db1df5964f37 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG cinder.quota [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Created reservations ['0613c669-68bc-4c39-bf1a-349fd69a3cc4', '78bf08f1-2ae8-4392-9f46-ec42014f6ab1', 'c648384e-e147-46e2-88f1-49292bffa7c0', '74196645-b8f8-4f1d-8628-33f5651887c2'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=56,cinder:UPDATE=33,cinder:DELETE=4,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276155392', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:16:31 user cinder-volume[73393]: DEBUG cinder.manager [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:16:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Deleted volume successfully. Apr 14 04:16:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b6ec177a-6255-4428-85ca-54caaab3cba2 tempest-VolumesTestJSON-1547245948 None] Lock "cinder-592547ad-a107-4cca-b4b4-db1df5964f37-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Flow 'volume_create_manager' (1325c4f9-54b2-42de-9dd9-7635f3d57b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b646337-326c-4c98-aedd-e705f5543632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b646337-326c-4c98-aedd-e705f5543632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2087544389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=524fc78b-afb1-41a7-bf19-e6d1a9af819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d466ad62c154f598dbf665ed9f09924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:38Z,use_quota=True,user_id='66841164fd30455d97ea4b281601a436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c639dda4-c13b-476e-9698-461eabf08b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c639dda4-c13b-476e-9698-461eabf08b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561fbec6-8b5b-46d0-94a0-bd575674dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561fbec6-8b5b-46d0-94a0-bd575674dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'volume_name': 'volume-524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5910616e-b992-43cf-b521-49de1f2078bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5910616e-b992-43cf-b521-49de1f2078bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf2cde0-1687-407d-b838-613822c6a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:37 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Volume 524fc78b-afb1-41a7-bf19-e6d1a9af819c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'volume_size': 1} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] creating volume v_524fc78b-afb1-41a7-bf19-e6d1a9af819c. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] create volume {'name': 'v_524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'is_clone': False, 'name': 'v_524fc78b-afb1-41a7-bf19-e6d1a9af819c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf2cde0-1687-407d-b838-613822c6a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9438b83c-2588-4179-9724-c09d347fab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:38 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Volume volume-524fc78b-afb1-41a7-bf19-e6d1a9af819c (524fc78b-afb1-41a7-bf19-e6d1a9af819c): created successfully Apr 14 04:16:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9438b83c-2588-4179-9724-c09d347fab87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Flow 'volume_create_manager' (1325c4f9-54b2-42de-9dd9-7635f3d57b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:38 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d2755ef5-efaf-49cc-98e3-229e0a593377 tempest-VolumesServicesTestJSON-1431743021 None] Created volume successfully. Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Acquiring lock "cinder-524fc78b-afb1-41a7-bf19-e6d1a9af819c-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Lock "cinder-524fc78b-afb1-41a7-bf19-e6d1a9af819c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] remove_export for volume: 524fc78b-afb1-41a7-bf19-e6d1a9af819c. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2087544389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=524fc78b-afb1-41a7-bf19-e6d1a9af819c,launched_at=2023-04-14T04:16:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d466ad62c154f598dbf665ed9f09924',provider_auth='CHAP efMiDmEF tHTWygAjUL1XYz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:38Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:16:40Z,updated_at=2023-04-14T04:16:40Z,use_quota=True,user_id='66841164fd30455d97ea4b281601a436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] detach volume v_524fc78b-afb1-41a7-bf19-e6d1a9af819c from target iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c/luns/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c/luns/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c/luns/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c/luns/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] failed to remove resource iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c because of JDSS resource v_524fc78b-afb1-41a7-bf19-e6d1a9af819c DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] delete target: iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] delete target iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] failed to remove resource iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c because of JDSS resource iqn.2010-10.org.openstack:524fc78b-afb1-41a7-bf19-e6d1a9af819c DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] deleating volume v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] get snapshots for volume v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] get volume v_524fc78b-afb1-41a7-bf19-e6d1a9af819c info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:16:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447207', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114777', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6001938430437893324', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b05145925b5c197d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276073472', 'san:volume_id': 'b05145925b5c197d1ef43fce61103e828d1bd632', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87120', 'name': 'v_524fc78b-afb1-41a7-bf19-e6d1a9af819c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] delete volume:v_524fc78b-afb1-41a7-bf19-e6d1a9af819c recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:16:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_524fc78b-afb1-41a7-bf19-e6d1a9af819c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] volume v_524fc78b-afb1-41a7-bf19-e6d1a9af819c deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:16:43 user cinder-volume[73393]: DEBUG cinder.quota [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Created reservations ['7f776451-0332-4eda-a2bf-5447b6c998e9', '30b8424d-2533-4f80-997f-0860b63287d0', '4291cdb5-e152-4841-a37f-2a46415ec7d9', '19e9b398-cd0f-46b8-9640-b1ef3641077f'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:16:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:16:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:16:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276155392', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:16:44 user cinder-volume[73393]: DEBUG cinder.manager [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:16:44 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Deleted volume successfully. Apr 14 04:16:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9a328c75-6df4-4d17-b9fa-98daf4f918bf tempest-VolumesServicesTestJSON-1431743021 None] Lock "cinder-524fc78b-afb1-41a7-bf19-e6d1a9af819c-delete_volume" released by "delete_volume" :: held 4.172s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Flow 'volume_create_manager' (2c5a87ab-64c6-438b-8634-e9943d4f9da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cba81a-a685-4d0b-a517-11591e70fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cba81a-a685-4d0b-a517-11591e70fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-767761709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94780c0c-bf63-4ed8-96ca-d77a4cf5bfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49dbc8850e9c4f4b99428b95dd0821ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:54Z,use_quota=True,user_id='80446589e8894ca9b7a846e8877f5b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358c3b31-36c9-41ef-83ae-663eaad954ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358c3b31-36c9-41ef-83ae-663eaad954ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee2d821-13c3-4400-a20c-3656b1c95cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee2d821-13c3-4400-a20c-3656b1c95cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'volume_name': 'volume-94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da88fba7-48a1-4808-89ce-58c0e81fabb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da88fba7-48a1-4808-89ce-58c0e81fabb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a649ad15-a73b-48b6-beaf-ab6173b6dc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Volume 94780c0c-bf63-4ed8-96ca-d77a4cf5bfae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'volume_size': 1} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] creating volume v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] create volume {'name': 'v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Flow 'volume_create_manager' (2b2c839f-fa79-4113-8d20-3d4a88349bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f4df4b-7e15-4e11-a079-8b11d345656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f4df4b-7e15-4e11-a079-8b11d345656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1539333457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80a9f7e6-e364-4c2b-9814-96061ad47dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cefa66350a4432ad71204b39e953be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:55Z,use_quota=True,user_id='0aeeeae7cbc340daa8cd81c1418794e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e90938-4527-476c-92e3-a4c6a27dead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e90938-4527-476c-92e3-a4c6a27dead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1c52a2-35a7-4c55-9b52-5aee945f1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1c52a2-35a7-4c55-9b52-5aee945f1148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'volume_name': 'volume-80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfde211a-818e-41d0-984d-2243b254ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfde211a-818e-41d0-984d-2243b254ac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9462423-e642-4e91-9d4f-e993d5922939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Volume 80a9f7e6-e364-4c2b-9814-96061ad47dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'volume_size': 1} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] creating volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] create volume {'name': 'v_80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'is_clone': False, 'name': 'v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a649ad15-a73b-48b6-beaf-ab6173b6dc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651c0c24-2d0a-4ffc-9962-4595c119e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Volume volume-94780c0c-bf63-4ed8-96ca-d77a4cf5bfae (94780c0c-bf63-4ed8-96ca-d77a4cf5bfae): created successfully Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651c0c24-2d0a-4ffc-9962-4595c119e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Flow 'volume_create_manager' (2c5a87ab-64c6-438b-8634-e9943d4f9da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-69d44914-382d-4db1-ab92-f040f1d4b878 tempest-AbsoluteLimitsTests-1147563046 None] Created volume successfully. Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'is_clone': False, 'name': 'v_80a9f7e6-e364-4c2b-9814-96061ad47dd6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9462423-e642-4e91-9d4f-e993d5922939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9487179-b586-447e-8fc2-b4760b7fffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:56 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Volume volume-80a9f7e6-e364-4c2b-9814-96061ad47dd6 (80a9f7e6-e364-4c2b-9814-96061ad47dd6): created successfully Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9487179-b586-447e-8fc2-b4760b7fffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Flow 'volume_create_manager' (2b2c839f-fa79-4113-8d20-3d4a88349bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:56 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b3f1886e-c1de-4cb2-bbc3-07991e20c4bc tempest-TaggedAttachmentsTest-926384577 None] Created volume successfully. Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.coordination [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Acquiring lock "cinder-94780c0c-bf63-4ed8-96ca-d77a4cf5bfae-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.coordination [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Lock "cinder-94780c0c-bf63-4ed8-96ca-d77a4cf5bfae-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] remove_export for volume: 94780c0c-bf63-4ed8-96ca-d77a4cf5bfae. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-767761709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94780c0c-bf63-4ed8-96ca-d77a4cf5bfae,launched_at=2023-04-14T04:16:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49dbc8850e9c4f4b99428b95dd0821ba',provider_auth='CHAP AIjPiZNJ Kc3pFnzyMxWHQD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:16:57Z,updated_at=2023-04-14T04:16:57Z,use_quota=True,user_id='80446589e8894ca9b7a846e8877f5b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] detach volume v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae from target iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae/luns/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae/luns/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae/luns/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae/luns/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] failed to remove resource iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae because of JDSS resource v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] delete target: iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] delete target iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] failed to remove resource iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae because of JDSS resource iqn.2010-10.org.openstack:94780c0c-bf63-4ed8-96ca-d77a4cf5bfae DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] deleating volume v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] get snapshots for volume v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] get volume v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447223', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114784', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '567388394387969138', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3c653d792b35106c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275991552', 'san:volume_id': '3c653d792b35106c3885a4dbcb012d14e41c989d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87697', 'name': 'v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] delete volume:v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:16:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (14633642-6586-497b-ade7-18ab93775fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce816cf-8925-4efc-8895-3c4439bedefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce816cf-8925-4efc-8895-3c4439bedefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-224844915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=31382528-1966-4f19-8a4a-94983a6314c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:58Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f9f744-285d-455c-a34f-1c0ed17ba4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f9f744-285d-455c-a34f-1c0ed17ba4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cae213-81c9-428a-bcdd-e1638670780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cae213-81c9-428a-bcdd-e1638670780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31382528-1966-4f19-8a4a-94983a6314c3', 'volume_name': 'volume-31382528-1966-4f19-8a4a-94983a6314c3', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea4e56-319d-4a91-8c17-e71a525669d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea4e56-319d-4a91-8c17-e71a525669d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950532c7-4763-4550-8603-7703fb635c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:16:58 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume 31382528-1966-4f19-8a4a-94983a6314c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31382528-1966-4f19-8a4a-94983a6314c3', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Cloning 31382528-1966-4f19-8a4a-94983a6314c3 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Preparing cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 04:16:58 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:16:59 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2, size 15.55 MB, duration 1.00 sec {{(pid=73393) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 04:16:59 user cinder-volume[73393]: INFO cinder.image.image_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Image download 15.55 MB at 15.55 MB/s Apr 14 04:16:59 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:16:59 user sudo[80928]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 Apr 14 04:16:59 user sudo[80928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:16:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:16:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] volume v_94780c0c-bf63-4ed8-96ca-d77a4cf5bfae deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:16:59 user cinder-volume[73393]: DEBUG cinder.quota [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Created reservations ['1f8ae9b6-1431-477c-9fe4-07dbeb8a1c2f', 'f0be5806-8da5-459b-89b4-28d96614b2dd', 'ba4508d4-fbff-4789-9a25-b1e3daa08536', '8311e385-c021-4f91-aca0-7e7ae1d2372f'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:17:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:17:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:17:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:00 user sudo[80928]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:00 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2" returned: 0 in 1.383s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:00 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Temporary image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 is fetched for user b848680106b74275a947f316ce6311fd. {{(pid=73393) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 04:17:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276061184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:17:01 user cinder-volume[73393]: DEBUG cinder.manager [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:17:01 user cinder-volume[73393]: INFO cinder.volume.manager [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Deleted volume successfully. Apr 14 04:17:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-15556970-bb09-4941-83fa-f38090d52bb7 tempest-AbsoluteLimitsTests-1147563046 None] Lock "cinder-94780c0c-bf63-4ed8-96ca-d77a4cf5bfae-delete_volume" released by "delete_volume" :: held 4.257s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:17:01 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=49,cinder:DELETE=3,cinder:UPDATE=21,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:01 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:01 user sudo[80947]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 Apr 14 04:17:01 user sudo[80947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:17:02 user sudo[80947]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:02 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2" returned: 0 in 1.354s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] creating volume v_31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] create volume {'name': 'v_31382528-1966-4f19-8a4a-94983a6314c3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Flow 'volume_create_manager' (ef2bcd03-efe3-4ab7-89bc-66236734c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576ac0fa-5edd-4411-9ae4-19628e124ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576ac0fa-5edd-4411-9ae4-19628e124ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1291039934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f3255f25-0334-46dd-a514-12a56a1deffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffadee5eeb7f4b42ae93e2e2578ef897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:17:03Z,use_quota=True,user_id='1da030e7c9e44f9b82f3286378a2ede6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af72bfb-54cf-4ffe-bbed-f3d1ac86724d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af72bfb-54cf-4ffe-bbed-f3d1ac86724d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcb9138-79a3-4d8f-abfb-eb3800488a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcb9138-79a3-4d8f-abfb-eb3800488a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3255f25-0334-46dd-a514-12a56a1deffd', 'volume_name': 'volume-f3255f25-0334-46dd-a514-12a56a1deffd', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5477ce-f80f-43fe-950f-7a7f786ff73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5477ce-f80f-43fe-950f-7a7f786ff73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac1ea4f-886d-425b-aec3-7eca8c09cf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:03 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Volume f3255f25-0334-46dd-a514-12a56a1deffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3255f25-0334-46dd-a514-12a56a1deffd', 'volume_size': 1} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] creating volume v_f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] create volume {'name': 'v_f3255f25-0334-46dd-a514-12a56a1deffd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_31382528-1966-4f19-8a4a-94983a6314c3', 'is_clone': False, 'name': 'v_31382528-1966-4f19-8a4a-94983a6314c3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Attempting download of 5c55a1da-f6f8-4442-939b-f0cb72ea4327 ((None, None)) to volume 31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] copy_image_to_volume volume-31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 04:17:03 user cinder-volume[73393]: DEBUG os_brick.utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:17:03 user cinder-volume[73393]: INFO oslo.privsep.daemon [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5qqj55uh/privsep.sock'] Apr 14 04:17:03 user sudo[81096]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5qqj55uh/privsep.sock Apr 14 04:17:03 user sudo[81096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:17:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f3255f25-0334-46dd-a514-12a56a1deffd', 'is_clone': False, 'name': 'v_f3255f25-0334-46dd-a514-12a56a1deffd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac1ea4f-886d-425b-aec3-7eca8c09cf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3255f25-0334-46dd-a514-12a56a1deffd', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c37a66-15f3-4caf-90ae-500e0c3cd532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:04 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Volume volume-f3255f25-0334-46dd-a514-12a56a1deffd (f3255f25-0334-46dd-a514-12a56a1deffd): created successfully Apr 14 04:17:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c37a66-15f3-4caf-90ae-500e0c3cd532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Flow 'volume_create_manager' (ef2bcd03-efe3-4ab7-89bc-66236734c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:04 user cinder-volume[73393]: INFO cinder.volume.manager [None req-62e36d0a-df61-44f2-9846-60eeb4963795 tempest-TestVolumeSwap-926061730 None] Created volume successfully. Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Flow 'volume_create_manager' (1b0ad482-734f-450c-b0af-e6917aa8d9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e1f87-b8ae-4a95-b376-f9d21950d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e1f87-b8ae-4a95-b376-f9d21950d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-24781138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffadee5eeb7f4b42ae93e2e2578ef897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:17:06Z,use_quota=True,user_id='1da030e7c9e44f9b82f3286378a2ede6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c36352-e53f-4881-af5c-c68fdb6e8971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c36352-e53f-4881-af5c-c68fdb6e8971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15f93e4-9bf8-4d76-8151-6f73a6d9e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15f93e4-9bf8-4d76-8151-6f73a6d9e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'volume_name': 'volume-eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c938db03-c6a3-4305-ab25-3665519e3979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c938db03-c6a3-4305-ab25-3665519e3979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a88257-7143-4a18-81ee-23a12382b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:05 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Volume eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'volume_size': 1} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] creating volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] create volume {'name': 'v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:06 user sudo[81096]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:06 user cinder-volume[73393]: INFO oslo.privsep.daemon [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Spawned new privsep daemon via rootwrap Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Accepted privsep connection to /tmp/tmp5qqj55uh/privsep.sock {{(pid=73393) __init__ /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:362}} Apr 14 04:17:06 user cinder-volume[73393]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 14 04:17:06 user cinder-volume[73393]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 14 04:17:06 user cinder-volume[73393]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none Apr 14 04:17:06 user cinder-volume[73393]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81102 Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc9bf5a-c2ae-4181-9d80-f493ea8a1b65]: (2,) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[b103860b-d9a7-4684-b882-814439b5a299]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66f2ad7cf0e5\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:06 user cinder-volume[73393]: WARNING os_brick.initiator.connectors.nvmeof [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[172aed80-169d-46a3-b83b-eb33763d3366]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e6d82-64cc-4c98-bd68-13be9acca11d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d62630-e433-41cd-b773-6e5bf7c9172b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): nvme version {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] 'nvme version' failed. Not Retrying. {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] nvme not present on system {{(pid=73393) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'is_clone': False, 'name': 'v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a88257-7143-4a18-81ee-23a12382b518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5915c3ba-089a-4a86-8e0f-28c7f9b766b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 04:17:06 user cinder-volume[73393]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 04:17:06 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deffca4-7a23-4d13-afde-ae5561c37def]: (4, '') {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73393) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73393) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] LIGHTOS: no hostnqn found. {{(pid=73393) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG os_brick.utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] <== get_connector_properties: return (3152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66f2ad7cf0e5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume 31382528-1966-4f19-8a4a-94983a6314c3: creating export {{(pid=73393) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] create export for volume: 31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] ensure volume 31382528-1966-4f19-8a4a-94983a6314c3 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] check if targe iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:06 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Volume volume-eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 (eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370): created successfully Apr 14 04:17:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5915c3ba-089a-4a86-8e0f-28c7f9b766b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Flow 'volume_create_manager' (1b0ad482-734f-450c-b0af-e6917aa8d9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] create target and attach volume 31382528-1966-4f19-8a4a-94983a6314c3 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:17:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] create target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:17:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-268cc1ca-3432-4226-9cf1-d9addf37098e tempest-TestVolumeSwap-926061730 None] Created volume successfully. Apr 14 04:17:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=59,cinder:UPDATE=31,cinder:INSERT=2,cinder:DELETE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:08 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Flow 'volume_create_manager' (80c61f2d-e2a4-4b51-a073-a110eb8f195f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82f423f-9824-4b8d-8a7b-647a3c5c4038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82f423f-9824-4b8d-8a7b-647a3c5c4038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1058802214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=68b36d43-588e-47e0-b935-0a2f3331e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4d313f3bc49afa2205dee2d979fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:17:09Z,use_quota=True,user_id='9d132b94c1804e4bbf96883dab59c97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435c179a-fab0-4cfc-bc4a-79d545c92c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435c179a-fab0-4cfc-bc4a-79d545c92c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975a8749-02bc-4d6b-83a1-3361cf05f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975a8749-02bc-4d6b-83a1-3361cf05f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b36d43-588e-47e0-b935-0a2f3331e0ec', 'volume_name': 'volume-68b36d43-588e-47e0-b935-0a2f3331e0ec', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021f8bca-0c3c-4d10-9ed0-ed5438ae8dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021f8bca-0c3c-4d10-9ed0-ed5438ae8dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888ac5f6-32cf-4b16-8bea-b50394a10738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:09 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Volume 68b36d43-588e-47e0-b935-0a2f3331e0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b36d43-588e-47e0-b935-0a2f3331e0ec', 'volume_size': 1} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] creating volume v_68b36d43-588e-47e0-b935-0a2f3331e0ec. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] create volume {'name': 'v_68b36d43-588e-47e0-b935-0a2f3331e0ec', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_68b36d43-588e-47e0-b935-0a2f3331e0ec', 'is_clone': False, 'name': 'v_68b36d43-588e-47e0-b935-0a2f3331e0ec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888ac5f6-32cf-4b16-8bea-b50394a10738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b36d43-588e-47e0-b935-0a2f3331e0ec', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b1fca1-f36d-4490-9b3a-a8b4078e2206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:10 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Volume volume-68b36d43-588e-47e0-b935-0a2f3331e0ec (68b36d43-588e-47e0-b935-0a2f3331e0ec): created successfully Apr 14 04:17:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b1fca1-f36d-4490-9b3a-a8b4078e2206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Flow 'volume_create_manager' (80c61f2d-e2a4-4b51-a073-a110eb8f195f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9c1698d6-1bff-410b-94f1-012e0cb8de0e tempest-VolumesTransfersV355Test-625716028 None] Created volume successfully. Apr 14 04:17:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] atach volume v_31382528-1966-4f19-8a4a-94983a6314c3 to target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:17:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1d3450a2-ee22-47e5-ad04-6ffd4366a28a tempest-VolumesTransfersV355Test-833831099 None] Transfer volume completed successfully. Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Acquiring lock "cinder-68b36d43-588e-47e0-b935-0a2f3331e0ec-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Lock "cinder-68b36d43-588e-47e0-b935-0a2f3331e0ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] remove_export for volume: 68b36d43-588e-47e0-b935-0a2f3331e0ec. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1058802214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=68b36d43-588e-47e0-b935-0a2f3331e0ec,launched_at=2023-04-14T04:17:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc92a031dd3340e78455b5e040c3366f',provider_auth='CHAP ixlQOGLq 3B8VDjIN7lg0Zt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:09Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:17:13Z,updated_at=2023-04-14T04:17:13Z,use_quota=True,user_id='0d91a766a29e495aba7b05c34e83ecfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] detach volume v_68b36d43-588e-47e0-b935-0a2f3331e0ec from target iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec/luns/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec/luns/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec/luns/v_68b36d43-588e-47e0-b935-0a2f3331e0ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec/luns/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] failed to remove resource iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec because of JDSS resource v_68b36d43-588e-47e0-b935-0a2f3331e0ec DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] delete target: iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] delete target iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] failed to remove resource iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec because of JDSS resource iqn.2010-10.org.openstack:68b36d43-588e-47e0-b935-0a2f3331e0ec DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] deleating volume v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] get snapshots for volume v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3132323161306233', 'lun': 0, 'mode': 'wt', 'name': 'v_31382528-1966-4f19-8a4a-94983a6314c3', 'prod_id': 'Storage', 'scsi_id': '1221a0b31c6cf303'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] add credentails to target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'name': 'ZFpuzxGw'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] initialize_connection for 31382528-1966-4f19-8a4a-94983a6314c3 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connector [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Factory for iscsi on None {{(pid=73393) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFpuzxGw', 'auth_password': '***', 'target_lun': False}}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:17:13 user cinder-volume[73393]: INFO os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260" returned: 21 in 0.045s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf40481-c32a-4901-a48e-ce24f2c528a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 04:17:13 user cinder-volume[73393]: {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee9f8ce-1aad-4a06-820f-daba799ded4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3] added\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3] added Apr 14 04:17:13 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ff37a0-8ff2-4925-a6de-088c8e797c06]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[676aed30-b075-439f-83a2-fa561bb40b82]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFpuzxGw {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFpuzxGw" returned: 0 in 0.023s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19afc8-5a37-4d8d-a63b-d90f286281ec]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZFpuzxGw'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c841263-3c51-4157-aaf4-e7d7e573fe21]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[28444a46-53af-46bb-b554-21414d1805b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Apr 14 04:17:13 user cinder-volume[73393]: {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Apr 14 04:17:13 user cinder-volume[73393]: {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:17:13 user cinder-volume[73393]: WARNING os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Apr 14 04:17:13 user cinder-volume[73393]: Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --login {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] get volume v_68b36d43-588e-47e0-b935-0a2f3331e0ec info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_68b36d43-588e-47e0-b935-0a2f3331e0ec', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447238', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114805', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5885874144337851927', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6519b3ee7e6e2e43', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275770368', 'san:volume_id': '6519b3ee7e6e2e43b1d5c0f56d0cb05626c0daf9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87829', 'name': 'v_68b36d43-588e-47e0-b935-0a2f3331e0ec', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] delete volume:v_68b36d43-588e-47e0-b935-0a2f3331e0ec recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.127s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d915da4-827a-409a-9c26-ac3c5429d6e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260] Apr 14 04:17:13 user cinder-volume[73393]: Login to [iface: default, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260] successful. Apr 14 04:17:13 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d9c1b2-af4e-4899-9b37-539b277d7e86]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2064f4-b59f-4bdf-bde8-56b5bbdadd4e]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 (non-flash) Apr 14 04:17:13 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 (non-flash) Apr 14 04:17:13 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Connected to 172.16.0.220:3260 {{(pid=73393) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=73393) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Scanning host 33 c: -, t: -, l: 0) {{(pid=73393) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[46976b06-f1f8-4c8e-bf45-aef573ef5db5]: (4, ('- - 0', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73393) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 04:17:13 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFpuzxGw', 'auth_password': '***', 'target_lun': False} {{(pid=73393) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 04:17:14 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:17:14 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23132323161306233', 'path': '/dev/sdb'} {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:17:14 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdb of=/dev/null count=1 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:15 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdb of=/dev/null count=1" returned: 0 in 0.121s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:15 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d5278c-ff9c-496a-b91f-0c6d5edc9dd1]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00181197 s, 283 kB/s\n')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:15 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_5c55a1da-f6f8-4442-939b-f0cb72ea4327__kcm3c17 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:15 user sudo[81570]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_5c55a1da-f6f8-4442-939b-f0cb72ea4327__kcm3c17 Apr 14 04:17:15 user sudo[81570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:17:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68b36d43-588e-47e0-b935-0a2f3331e0ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] volume v_68b36d43-588e-47e0-b935-0a2f3331e0ec deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.quota [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Created reservations ['4690bfea-90e7-4727-b0aa-e398603b1295', '117879d7-9874-4351-8088-f44b0cd8129c', '665d99a5-96d9-4ac5-ac9a-e230abfb02dd', 'cd4516d6-29df-47b7-8f8c-398ad61d97a2'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:16 user sudo[81570]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_5c55a1da-f6f8-4442-939b-f0cb72ea4327__kcm3c17" returned: 0 in 0.933s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:16 user sudo[81576]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 Apr 14 04:17:16 user sudo[81576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275864576', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.manager [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:17:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Deleted volume successfully. Apr 14 04:17:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6453a9d0-2142-4e38-8abf-9bd5355ca7ce tempest-VolumesTransfersV355Test-632016107 None] Lock "cinder-68b36d43-588e-47e0-b935-0a2f3331e0ec-delete_volume" released by "delete_volume" :: held 4.134s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:17:17 user sudo[81576]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:17 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2" returned: 0 in 0.993s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] 5c55a1da-f6f8-4442-939b-f0cb72ea4327 was qcow2, converting to raw {{(pid=73393) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 of=/dev/sdb oflag=direct {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:17 user sudo[81586]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 of=/dev/sdb oflag=direct Apr 14 04:17:17 user sudo[81586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Flow 'volume_create_manager' (726d0257-a669-48ae-bd3e-94b63de8f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc0a28-1044-4a24-a349-58d787e4c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc0a28-1044-4a24-a349-58d787e4c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1854292399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80f48493-2123-4a25-b026-eebeab728434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4d313f3bc49afa2205dee2d979fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:17:18Z,use_quota=True,user_id='9d132b94c1804e4bbf96883dab59c97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0564340-21ea-47a6-937c-b3f79c63ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0564340-21ea-47a6-937c-b3f79c63ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32529e93-6abf-4b1b-8c87-388d9ee7d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32529e93-6abf-4b1b-8c87-388d9ee7d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f48493-2123-4a25-b026-eebeab728434', 'volume_name': 'volume-80f48493-2123-4a25-b026-eebeab728434', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9048b239-1705-43ee-8bfd-fc04f5d3ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9048b239-1705-43ee-8bfd-fc04f5d3ed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e640a533-907b-4104-b9bc-21139f411b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:17 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Volume 80f48493-2123-4a25-b026-eebeab728434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f48493-2123-4a25-b026-eebeab728434', 'volume_size': 1} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] creating volume v_80f48493-2123-4a25-b026-eebeab728434. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] create volume {'name': 'v_80f48493-2123-4a25-b026-eebeab728434', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:17 user sudo[81586]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:17 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 of=/dev/sdb oflag=direct" returned: 0 in 0.853s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:17 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 /dev/sdb {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:17 user sudo[81605]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 /dev/sdb Apr 14 04:17:17 user sudo[81605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:17:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_80f48493-2123-4a25-b026-eebeab728434', 'is_clone': False, 'name': 'v_80f48493-2123-4a25-b026-eebeab728434'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e640a533-907b-4104-b9bc-21139f411b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f48493-2123-4a25-b026-eebeab728434', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca40f101-d108-42fd-8b03-73325ab958b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:19 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Volume volume-80f48493-2123-4a25-b026-eebeab728434 (80f48493-2123-4a25-b026-eebeab728434): created successfully Apr 14 04:17:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca40f101-d108-42fd-8b03-73325ab958b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Flow 'volume_create_manager' (726d0257-a669-48ae-bd3e-94b63de8f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:19 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f260a559-bfb1-4290-bceb-9468f96f7243 tempest-VolumesTransfersV355Test-625716028 None] Created volume successfully. Apr 14 04:17:19 user sudo[81605]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:19 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 /dev/sdb" returned: 0 in 1.868s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:19 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:19 user sudo[81739]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2 Apr 14 04:17:19 user sudo[81739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Acquiring lock "cinder-80f48493-2123-4a25-b026-eebeab728434-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Lock "cinder-80f48493-2123-4a25-b026-eebeab728434-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] remove_export for volume: 80f48493-2123-4a25-b026-eebeab728434. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1854292399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80f48493-2123-4a25-b026-eebeab728434,launched_at=2023-04-14T04:17:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4d313f3bc49afa2205dee2d979fe7',provider_auth='CHAP LYbKpNCS EHVfQuonjm8cz2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:18Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:17:20Z,updated_at=2023-04-14T04:17:20Z,use_quota=True,user_id='9d132b94c1804e4bbf96883dab59c97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] detach volume v_80f48493-2123-4a25-b026-eebeab728434 from target iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434/luns/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434/luns/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434/luns/v_80f48493-2123-4a25-b026-eebeab728434'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434/luns/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] failed to remove resource iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 because of JDSS resource v_80f48493-2123-4a25-b026-eebeab728434 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] delete target: iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] delete target iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] failed to remove resource iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 because of JDSS resource iqn.2010-10.org.openstack:80f48493-2123-4a25-b026-eebeab728434 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] deleating volume v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] get snapshots for volume v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:20 user sudo[81739]: pam_unix(sudo:session): session closed for user root Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2" returned: 0 in 1.019s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c55a1da-f6f8-4442-939b-f0cb72ea4327_niqxtlecuser@joviandss-2, size 112.00 MB, duration 1.87 sec, destination /dev/sdb {{(pid=73393) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 04:17:20 user cinder-volume[73393]: INFO cinder.image.image_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Converted 112.00 MB image at 59.91 MB/s Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFpuzxGw', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23132323161306233', 'path': '/dev/sdb'}), 'kwargs': {'force': False}}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763727c-067d-4e4e-94e0-d282eb296e69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 04:17:20 user cinder-volume[73393]: No targets found. Apr 14 04:17:20 user cinder-volume[73393]: iSNS: Apr 14 04:17:20 user cinder-volume[73393]: No targets found. Apr 14 04:17:20 user cinder-volume[73393]: STATIC: Apr 14 04:17:20 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 Apr 14 04:17:20 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:17:20 user cinder-volume[73393]: Iface Name: default Apr 14 04:17:20 user cinder-volume[73393]: FIRMWARE: Apr 14 04:17:20 user cinder-volume[73393]: No targets found. Apr 14 04:17:20 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 04:17:20 user cinder-volume[73393]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 04:17:20 user cinder-volume[73393]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73393) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3', 0)] {{(pid=73393) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39b63d-e2f9-48ab-a7a2-16cd074600a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] get volume v_80f48493-2123-4a25-b026-eebeab728434 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[313c888f-dcd0-4ece-bb16-5d93bb88910e]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 (non-flash) Apr 14 04:17:20 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 (non-flash) Apr 14 04:17:20 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Resulting device map defaultdict(. at 0x7fd683bf0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3'): ({'sdb'}, set())}) {{(pid=73393) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Removing single pathed devices sdb {{(pid=73393) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_80f48493-2123-4a25-b026-eebeab728434', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447247', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114814', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8622442100615454326', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd4274355169f1e18', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114274312192', 'san:volume_id': 'd4274355169f1e1809856a65c547c202c999987b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88064', 'name': 'v_80f48493-2123-4a25-b026-eebeab728434', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] delete volume:v_80f48493-2123-4a25-b026-eebeab728434 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0f82d-7ef3-4a25-974d-8d814ec8051b]: (4, ('path checker states:\nup 1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab5c488-9fde-4de4-ba01-b154f79061b7]: (4, ('ok\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Flushing IO for device /dev/sdb {{(pid=73393) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[37889a2d-c20b-4963-9d5d-520bac1b9d28]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73393) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 04:17:20 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.073s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abdc248-a21d-456c-b14d-87212282a1bb]: (4, ('1', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=73393) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] SCSI volumes sdb have been removed. {{(pid=73393) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3')] {{(pid=73393) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[8257e152-b7c7-478b-b3a4-7dc88f76c0cd]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --logout {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e094b-92a7-431c-aa92-519acbf3f61b]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260] Apr 14 04:17:21 user cinder-volume[73393]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3, portal: 172.16.0.220,3260] successful. Apr 14 04:17:21 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op delete {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf31a50-810e-4332-b48e-2082020ec9b1]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] <== disconnect_volume: return (350ms) None {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] terminate connection for 31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] volume 31382528-1966-4f19-8a4a-94983a6314c3: removing export {{(pid=73393) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] remove_export for volume: 31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-224844915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=31382528-1966-4f19-8a4a-94983a6314c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth='CHAP ZFpuzxGw 4P9UZf5KuYplTQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T04:16:58Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume v_31382528-1966-4f19-8a4a-94983a6314c3 from target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Downloaded image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 ((None, None)) to volume 31382528-1966-4f19-8a4a-94983a6314c3 successfully. {{(pid=73393) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Temporary image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 for user b848680106b74275a947f316ce6311fd is deleted. {{(pid=73393) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.quota [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Created reservations ['2fe4f173-b51a-4f37-bd8d-411268ca47ec', '801ca653-cdcc-4ef1-9c3b-cbd27beb735d', 'a7d89547-937e-43be-8cc5-851c15cd1576', '62efd58b-08a4-4dd2-a5b2-5bad7f879280'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Creating image volume entry: {'provider_id': None, 'replication_extended_status': None, 'bootable': False, 'previous_status': None, 'service_uuid': None, 'metadata': {}, 'updated_at': datetime.datetime(2023, 4, 14, 4, 16, 58, tzinfo=datetime.timezone.utc), 'consistencygroup_id': None, 'terminated_at': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'deleted_at': None, 'volume_type_id': 'aae56b00-efa6-4456-b946-b0b57e8616a8', 'replication_driver_data': None, 'display_description': None, 'multiattach': False, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 0', 'size': 1, 'scheduled_at': datetime.datetime(2023, 4, 14, 4, 16, 58, tzinfo=datetime.timezone.utc), 'volume_metadata': [], 'project_id': '447e3d081a064aac847d4d452695f22d', 'group_id': None, 'ec2_id': None, 'shared_targets': True, 'availability_zone': 'nova', 'provider_geometry': None, 'user_id': 'b848680106b74275a947f316ce6311fd', 'provider_auth': 'CHAP ZFpuzxGw 4P9UZf5KuYplTQ', 'volume_admin_metadata': [], 'created_at': datetime.datetime(2023, 4, 14, 4, 16, 58, tzinfo=datetime.timezone.utc), 'replication_status': None, 'encryption_key_id': None, 'host': 'user@joviandss-2#joviandss-2', 'display_name': 'image-5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'launched_at': None, 'cluster_name': None, 'deleted': False, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '31382528-1966-4f19-8a4a-94983a6314c3'}. {{(pid=73393) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume reschedule parameters: False retry: None {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (23c21735-7b77-4f24-9307-dc2348c1c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299998f-848e-4157-8d74-7c9760b5f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299998f-848e-4157-8d74-7c9760b5f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='image-5c55a1da-f6f8-4442-939b-f0cb72ea4327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b0a9c0c1-47b3-429b-99b9-c9a847b4891f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='447e3d081a064aac847d4d452695f22d',provider_auth='CHAP ZFpuzxGw 4P9UZf5KuYplTQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=31382528-1966-4f19-8a4a-94983a6314c3,status='creating',terminated_at=None,updated_at=2023-04-14T04:16:58Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe057c3-4878-466c-b615-6702d1a97250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe057c3-4878-466c-b615-6702d1a97250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c469cf-5eb3-43f4-8143-947fd90a1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c469cf-5eb3-43f4-8143-947fd90a1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'volume_name': 'volume-b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'volume_size': 1, 'source_volid': '31382528-1966-4f19-8a4a-94983a6314c3', 'source_volstatus': 'downloading'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636d7ced-491c-43cd-911a-406c203eebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636d7ced-491c-43cd-911a-406c203eebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4b49c6-d453-4946-8b2d-c9969e6f1cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:22 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'volume_size': 1, 'source_volid': '31382528-1966-4f19-8a4a-94983a6314c3', 'source_volstatus': 'downloading'} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] cloned volume 31382528-1966-4f19-8a4a-94983a6314c3 to b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] cloning v_31382528-1966-4f19-8a4a-94983a6314c3 to v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] create snapshot v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80f48493-2123-4a25-b026-eebeab728434 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] volume v_80f48493-2123-4a25-b026-eebeab728434 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=63,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=9 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Created reservations ['ecf8ba86-b966-4df6-95e8-ebaca5a9865d', 'c6e8fa03-ea67-4108-a60a-7e872fbf333e', '1701b30e-4585-4cdd-8203-0f14d44ebf38', '454fd611-228d-4785-9071-45fcb02abe72'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] create volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f from snapshot v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Geting {'code': 200, 'error': None, 'data': {'available': '114259611648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.manager [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:17:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Deleted volume successfully. Apr 14 04:17:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-54ad8f4c-242d-4d26-8d4b-cfc394f792e6 tempest-VolumesTransfersV355Test-632016107 None] Lock "cinder-80f48493-2123-4a25-b026-eebeab728434-delete_volume" released by "delete_volume" :: held 3.721s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_31382528-1966-4f19-8a4a-94983a6314c3@v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'is_clone': True, 'full_name': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'name': 'v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] get volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_31382528-1966-4f19-8a4a-94983a6314c3@v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447252', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '114826', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14912101088468224660', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e08ea43eae083087', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114259566592', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '87733', 'name': 'v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4b49c6-d453-4946-8b2d-c9969e6f1cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'volume_size': 1, 'source_volid': '31382528-1966-4f19-8a4a-94983a6314c3', 'source_volstatus': 'downloading'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548256fb-3e22-4b83-ab9d-188efd1ef529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:24 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume volume-b0a9c0c1-47b3-429b-99b9-c9a847b4891f (b0a9c0c1-47b3-429b-99b9-c9a847b4891f): created successfully Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548256fb-3e22-4b83-ab9d-188efd1ef529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (23c21735-7b77-4f24-9307-dc2348c1c07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Created volume successfully. Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Creating new image-volume cache entry for image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on user@joviandss-2#joviandss-2 {{(pid=73393) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] New image-volume cache entry created: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 17, 24, 984540)}. {{(pid=73393) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 26.354s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:17:24 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Marking volume 31382528-1966-4f19-8a4a-94983a6314c3 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Creating volume glance metadata for volume 31382528-1966-4f19-8a4a-94983a6314c3 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=29,cinder:SELECT=57,cinder:DELETE=3,cinder:INSERT=11 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950532c7-4763-4550-8603-7703fb635c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31382528-1966-4f19-8a4a-94983a6314c3', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2679d186-297f-4a15-893f-6c03b0948096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:25 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume volume-31382528-1966-4f19-8a4a-94983a6314c3 (31382528-1966-4f19-8a4a-94983a6314c3): created successfully Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2679d186-297f-4a15-893f-6c03b0948096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (14633642-6586-497b-ade7-18ab93775fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ad980cdf-a500-4136-912d-374fcdc623a3 tempest-TaggedBootDevicesTest_v242-581315356 None] Created volume successfully. Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114259566592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:17:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (9db88718-71ef-4774-aad1-9a37412877bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bc1618-1896-4d08-9395-982746d40089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bc1618-1896-4d08-9395-982746d40089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1908156496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=18016742-a15a-4e85-9fb9-4cbfd819316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:17:26Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866b31c6-eb9c-4c9e-965b-f4d1dee265c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866b31c6-eb9c-4c9e-965b-f4d1dee265c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a90ef4-ed50-4db9-a057-370068a63f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a90ef4-ed50-4db9-a057-370068a63f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18016742-a15a-4e85-9fb9-4cbfd819316b', 'volume_name': 'volume-18016742-a15a-4e85-9fb9-4cbfd819316b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6d5db4-6b5a-445d-9383-ab24846291a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6d5db4-6b5a-445d-9383-ab24846291a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce52a192-f15f-4765-a1b3-78ced4558fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:26 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume 18016742-a15a-4e85-9fb9-4cbfd819316b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18016742-a15a-4e85-9fb9-4cbfd819316b', 'volume_size': 1} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] creating volume v_18016742-a15a-4e85-9fb9-4cbfd819316b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] create volume {'name': 'v_18016742-a15a-4e85-9fb9-4cbfd819316b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_18016742-a15a-4e85-9fb9-4cbfd819316b', 'is_clone': False, 'name': 'v_18016742-a15a-4e85-9fb9-4cbfd819316b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce52a192-f15f-4765-a1b3-78ced4558fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18016742-a15a-4e85-9fb9-4cbfd819316b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bb0d35-9452-414c-96c2-d9fb22138899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Volume volume-18016742-a15a-4e85-9fb9-4cbfd819316b (18016742-a15a-4e85-9fb9-4cbfd819316b): created successfully Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bb0d35-9452-414c-96c2-d9fb22138899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (9db88718-71ef-4774-aad1-9a37412877bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:27 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ab1bc4b2-e213-4101-9d64-54c865d74c81 tempest-TaggedBootDevicesTest_v242-581315356 None] Created volume successfully. Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Flow 'volume_create_manager' (1b0c558c-c569-4116-9c77-e036b0d18b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f495957a-bf55-4fb9-858a-329e7ae25816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f495957a-bf55-4fb9-858a-329e7ae25816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-596255099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7cc29a62-6173-4245-b275-65570e150acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd33d0b6e18f4cb38bef200534318808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:17:28Z,use_quota=True,user_id='c721f4f766ff4e5a942d09de95a9761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e932bf-6062-4f0f-a8e9-c9de0431f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e932bf-6062-4f0f-a8e9-c9de0431f50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbd54c6-f253-4b76-9d7f-d5019cea43d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbd54c6-f253-4b76-9d7f-d5019cea43d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc29a62-6173-4245-b275-65570e150acd', 'volume_name': 'volume-7cc29a62-6173-4245-b275-65570e150acd', 'volume_size': 2}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536118a5-ae0a-44cf-af3e-2cefcfc0857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536118a5-ae0a-44cf-af3e-2cefcfc0857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4d1977-3e8d-47e6-ab93-52a638c57f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Volume 7cc29a62-6173-4245-b275-65570e150acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc29a62-6173-4245-b275-65570e150acd', 'volume_size': 2} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] creating volume v_7cc29a62-6173-4245-b275-65570e150acd. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] create volume {'name': 'v_7cc29a62-6173-4245-b275-65570e150acd', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7cc29a62-6173-4245-b275-65570e150acd', 'is_clone': False, 'name': 'v_7cc29a62-6173-4245-b275-65570e150acd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (0fad60f5-385b-473e-ad9d-f779f12f2bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14aeff81-182d-47bd-bae9-0238d6cc0d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4d1977-3e8d-47e6-ab93-52a638c57f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc29a62-6173-4245-b275-65570e150acd', 'volume_size': 2}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1b0fd0-2fa6-46f3-9bce-75660dc0874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14aeff81-182d-47bd-bae9-0238d6cc0d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1888583181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c8315093-aba5-4adf-8381-c59806b42282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:17:29Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be13d6e-5bf7-4b52-ba03-d1c9df04fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be13d6e-5bf7-4b52-ba03-d1c9df04fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a600da93-12d2-45b8-881d-ad60c873fb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a600da93-12d2-45b8-881d-ad60c873fb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8315093-aba5-4adf-8381-c59806b42282', 'volume_name': 'volume-c8315093-aba5-4adf-8381-c59806b42282', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618dac6c-23a1-4c62-b4cb-3685b826d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618dac6c-23a1-4c62-b4cb-3685b826d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205be054-6dac-4a92-8a9d-46e7d583cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Volume c8315093-aba5-4adf-8381-c59806b42282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8315093-aba5-4adf-8381-c59806b42282', 'volume_size': 1} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] creating volume v_c8315093-aba5-4adf-8381-c59806b42282. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] create volume {'name': 'v_c8315093-aba5-4adf-8381-c59806b42282', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Volume volume-7cc29a62-6173-4245-b275-65570e150acd (7cc29a62-6173-4245-b275-65570e150acd): created successfully Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1b0fd0-2fa6-46f3-9bce-75660dc0874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Flow 'volume_create_manager' (1b0c558c-c569-4116-9c77-e036b0d18b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f1920a13-70a5-4401-b881-714f20729275 tempest-VolumesCloneNegativeTest-498490322 None] Created volume successfully. Apr 14 04:17:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c8315093-aba5-4adf-8381-c59806b42282', 'is_clone': False, 'name': 'v_c8315093-aba5-4adf-8381-c59806b42282'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205be054-6dac-4a92-8a9d-46e7d583cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8315093-aba5-4adf-8381-c59806b42282', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525a3251-8b30-48d1-a028-33103507c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:17:29 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Volume volume-c8315093-aba5-4adf-8381-c59806b42282 (c8315093-aba5-4adf-8381-c59806b42282): created successfully Apr 14 04:17:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525a3251-8b30-48d1-a028-33103507c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:17:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Flow 'volume_create_manager' (0fad60f5-385b-473e-ad9d-f779f12f2bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:17:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-967f94eb-f037-4cea-9285-3f1cee5fb87c tempest-TaggedBootDevicesTest_v242-581315356 None] Created volume successfully. Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.coordination [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Acquiring lock "cinder-7cc29a62-6173-4245-b275-65570e150acd-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.coordination [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Lock "cinder-7cc29a62-6173-4245-b275-65570e150acd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] remove_export for volume: 7cc29a62-6173-4245-b275-65570e150acd. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-596255099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7cc29a62-6173-4245-b275-65570e150acd,launched_at=2023-04-14T04:17:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd33d0b6e18f4cb38bef200534318808',provider_auth='CHAP hyNtGBIq teJqRMKdWAg4QS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:17:30Z,updated_at=2023-04-14T04:17:30Z,use_quota=True,user_id='c721f4f766ff4e5a942d09de95a9761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] detach volume v_7cc29a62-6173-4245-b275-65570e150acd from target iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd/luns/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd/luns/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd/luns/v_7cc29a62-6173-4245-b275-65570e150acd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd/luns/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] failed to remove resource iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd because of JDSS resource v_7cc29a62-6173-4245-b275-65570e150acd DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] delete target: iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] delete target iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] failed to remove resource iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd because of JDSS resource iqn.2010-10.org.openstack:7cc29a62-6173-4245-b275-65570e150acd DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] deleating volume v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] get snapshots for volume v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] get volume v_7cc29a62-6173-4245-b275-65570e150acd info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7cc29a62-6173-4245-b275-65570e150acd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447257', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114834', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1650755321540963508', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7270f50d5558b5d5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114259296256', 'san:volume_id': '7270f50d5558b5d5c76e920e8580a06d684e3875', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87578', 'name': 'v_7cc29a62-6173-4245-b275-65570e150acd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] delete volume:v_7cc29a62-6173-4245-b275-65570e150acd recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7cc29a62-6173-4245-b275-65570e150acd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] volume v_7cc29a62-6173-4245-b275-65570e150acd deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:17:32 user cinder-volume[73393]: DEBUG cinder.quota [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Created reservations ['6a29afc7-1352-4b45-95f2-7c19029e7545', 'b6798c2d-470c-4440-9a56-fac80794e45b', '3a21a3fb-cc85-430b-9b02-677173e04ced', '5d219f76-f0dc-4cf4-83ab-3f64350fc353'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:17:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:17:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:17:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Geting {'code': 200, 'error': None, 'data': {'available': '114259365888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:17:33 user cinder-volume[73393]: DEBUG cinder.manager [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:17:33 user cinder-volume[73393]: INFO cinder.volume.manager [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Deleted volume successfully. Apr 14 04:17:33 user cinder-volume[73393]: DEBUG cinder.coordination [None req-08e11b1e-5308-454a-bd20-7735945ed18f tempest-VolumesCloneNegativeTest-498490322 None] Lock "cinder-7cc29a62-6173-4245-b275-65570e150acd-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] create export for volume: 31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] ensure volume 31382528-1966-4f19-8a4a-94983a6314c3 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] check if targe iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] create target and attach volume 31382528-1966-4f19-8a4a-94983a6314c3 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] create target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=29,cinder:SELECT=56,cinder:DELETE=4,cinder:INSERT=11 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] atach volume v_31382528-1966-4f19-8a4a-94983a6314c3 to target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:17:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3132323161306233', 'lun': 0, 'mode': 'wt', 'name': 'v_31382528-1966-4f19-8a4a-94983a6314c3', 'prod_id': 'Storage', 'scsi_id': '1221a0b31c6cf303'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] add credentails to target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:17:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'name': 'ZFpuzxGw'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] initialize_connection for 31382528-1966-4f19-8a4a-94983a6314c3 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:17:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFpuzxGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e342f29f-eaa0-4d55-bbe5-e2dd4fd88e97'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:17:49 user cinder-volume[73393]: INFO cinder.volume.manager [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-e958f662-44d3-48a4-a208-25af9d8ef337 tempest-TaggedBootDevicesTest_v242-581315356 None] attachment_update completed successfully. Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] create export for volume: 18016742-a15a-4e85-9fb9-4cbfd819316b. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] ensure volume 18016742-a15a-4e85-9fb9-4cbfd819316b assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] check if targe iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] create target and attach volume 18016742-a15a-4e85-9fb9-4cbfd819316b to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] create target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] atach volume v_18016742-a15a-4e85-9fb9-4cbfd819316b to target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:17:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6164363435343866', 'lun': 0, 'mode': 'wt', 'name': 'v_18016742-a15a-4e85-9fb9-4cbfd819316b', 'prod_id': 'Storage', 'scsi_id': 'ad64548f162c4c25'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] add credentails to target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'name': 'nQRoZmkl'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] initialize_connection for 18016742-a15a-4e85-9fb9-4cbfd819316b 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQRoZmkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e2915d95-5bab-4b56-bc25-4f938db97e78'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:17:54 user cinder-volume[73393]: INFO cinder.volume.manager [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-ac6b39fd-04ed-4562-a7cf-16ad001351c0 tempest-TaggedBootDevicesTest_v242-581315356 None] attachment_update completed successfully. Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] create export for volume: c8315093-aba5-4adf-8381-c59806b42282. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] ensure volume c8315093-aba5-4adf-8381-c59806b42282 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] check if targe iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] create target and attach volume c8315093-aba5-4adf-8381-c59806b42282 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] create target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] atach volume v_c8315093-aba5-4adf-8381-c59806b42282 to target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:17:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=5,cinder:SELECT=58,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3062663337326138', 'lun': 0, 'mode': 'wt', 'name': 'v_c8315093-aba5-4adf-8381-c59806b42282', 'prod_id': 'Storage', 'scsi_id': '0bf372a81c5382c8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] add credentails to target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:17:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:17:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:17:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HjUKqOuQ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:17:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] initialize_connection for c8315093-aba5-4adf-8381-c59806b42282 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:17:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjUKqOuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a062bc6d-16a2-4670-acaf-78b62d1dfd90'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:17:59 user cinder-volume[73393]: INFO cinder.volume.manager [req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 req-996cb6a4-9e24-43b7-97d8-5cac88dca9f7 tempest-TaggedBootDevicesTest_v242-581315356 None] attachment_update completed successfully. Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5bf4282b-bdd9-4296-a12e-479685b06c50 tempest-VolumesActionsTest-447148503 None] Acquiring lock "cinder-16203803-41c1-4da7-804c-d344751cb449" by "attach_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5bf4282b-bdd9-4296-a12e-479685b06c50 tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449" acquired by "attach_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:18:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5bf4282b-bdd9-4296-a12e-479685b06c50 tempest-VolumesActionsTest-447148503 None] Attaching volume 16203803-41c1-4da7-804c-d344751cb449 to instance 0ff97860-2441-437c-b118-6089c3cc4160 at mountpoint /dev/vdb on host None. Apr 14 04:18:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5bf4282b-bdd9-4296-a12e-479685b06c50 tempest-VolumesActionsTest-447148503 None] Attach volume completed successfully. Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5bf4282b-bdd9-4296-a12e-479685b06c50 tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449" released by "attach_volume" :: held 0.067s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Acquiring lock "cinder-16203803-41c1-4da7-804c-d344751cb449-detach_volume" by "detach_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:18:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Detaching volume 16203803-41c1-4da7-804c-d344751cb449 from instance 0ff97860-2441-437c-b118-6089c3cc4160. Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] remove_export for volume: 16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355191391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=16203803-41c1-4da7-804c-d344751cb449,launched_at=2023-04-14T04:16:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280aa55745a749b7baa134334d25c9c3',provider_auth='CHAP wIRreYbm CcQBFaRTqU9NoM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:18Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:18:12Z,use_quota=True,user_id='6e422970cd8340bf996a135088094f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] detach volume v_16203803-41c1-4da7-804c-d344751cb449 from target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] failed to remove resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 because of JDSS resource v_16203803-41c1-4da7-804c-d344751cb449 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] delete target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] delete target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] failed to remove resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 because of JDSS resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:18:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Detach volume completed successfully. Apr 14 04:18:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4c99a456-52b4-4dc5-9971-03a14786ed10 tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449-detach_volume" released by "detach_volume" :: held 0.130s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:18:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:18:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:18:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:18:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114259288064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:18:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=43,cinder:UPDATE=17,cinder:INSERT=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Flow 'volume_create_manager' (8ee7434f-39f7-4ce1-b1d1-5b68093ac3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd62ab2-0fc3-4c71-a03a-9a3e6375698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd62ab2-0fc3-4c71-a03a-9a3e6375698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2034099743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b7e94002-3eeb-442d-b224-ef83dacfa5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:18:26Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f36d93-efba-4a70-8332-10a1779f310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f36d93-efba-4a70-8332-10a1779f310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b6ea1-c7c3-4373-9f17-e2a8efa3b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b6ea1-c7c3-4373-9f17-e2a8efa3b81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'volume_name': 'volume-b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8224c95-f62c-4f08-a71e-01054d28bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8224c95-f62c-4f08-a71e-01054d28bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5244768-74f1-4b7c-8c4b-1f84926bedda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:26 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Volume b7e94002-3eeb-442d-b224-ef83dacfa5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'volume_size': 1} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] creating volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] create volume {'name': 'v_b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'is_clone': False, 'name': 'v_b7e94002-3eeb-442d-b224-ef83dacfa5a4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5244768-74f1-4b7c-8c4b-1f84926bedda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8832df6-ef83-4647-ac5d-a434f7dc6841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Volume volume-b7e94002-3eeb-442d-b224-ef83dacfa5a4 (b7e94002-3eeb-442d-b224-ef83dacfa5a4): created successfully Apr 14 04:18:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8832df6-ef83-4647-ac5d-a434f7dc6841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Flow 'volume_create_manager' (8ee7434f-39f7-4ce1-b1d1-5b68093ac3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:18:27 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f89751e8-7a72-49f3-b4f2-112fd151fbba tempest-AttachVolumeTestJSON-991906288 None] Created volume successfully. Apr 14 04:18:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=35,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Flow 'volume_create_manager' (fa25be04-77c0-4407-a417-97fb242bbc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6308bef9-ac59-4540-a169-72edb1282de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6308bef9-ac59-4540-a169-72edb1282de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-339573791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=09a4582c-404d-4225-baf5-59b74e42325d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5e634f187b470085e7bfb3c1cfcbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:18:29Z,use_quota=True,user_id='fab852bb302f44b1af63083c99ea244c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71230681-e893-40df-973b-c1c2cbfe4fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71230681-e893-40df-973b-c1c2cbfe4fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441f25ed-175c-42e2-854f-6e883f68b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441f25ed-175c-42e2-854f-6e883f68b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a4582c-404d-4225-baf5-59b74e42325d', 'volume_name': 'volume-09a4582c-404d-4225-baf5-59b74e42325d', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a22716-f476-4df5-aaa7-97d01d720877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a22716-f476-4df5-aaa7-97d01d720877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740e909-5516-4fbc-a967-3b89a0bb8ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Volume 09a4582c-404d-4225-baf5-59b74e42325d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a4582c-404d-4225-baf5-59b74e42325d', 'volume_size': 1} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] creating volume v_09a4582c-404d-4225-baf5-59b74e42325d. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] create volume {'name': 'v_09a4582c-404d-4225-baf5-59b74e42325d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] create export for volume: b7e94002-3eeb-442d-b224-ef83dacfa5a4. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] ensure volume b7e94002-3eeb-442d-b224-ef83dacfa5a4 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] check if targe iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] create target and attach volume b7e94002-3eeb-442d-b224-ef83dacfa5a4 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] create target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_09a4582c-404d-4225-baf5-59b74e42325d', 'is_clone': False, 'name': 'v_09a4582c-404d-4225-baf5-59b74e42325d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740e909-5516-4fbc-a967-3b89a0bb8ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a4582c-404d-4225-baf5-59b74e42325d', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900a45b3-30cb-47b7-b871-7e18002be085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:29 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Volume volume-09a4582c-404d-4225-baf5-59b74e42325d (09a4582c-404d-4225-baf5-59b74e42325d): created successfully Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900a45b3-30cb-47b7-b871-7e18002be085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Flow 'volume_create_manager' (fa25be04-77c0-4407-a417-97fb242bbc85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:18:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-26eb78f6-6109-430d-b625-a4766aaf2506 tempest-DeleteServersTestJSON-2046031715 None] Created volume successfully. Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] create export for volume: 09a4582c-404d-4225-baf5-59b74e42325d. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] ensure volume 09a4582c-404d-4225-baf5-59b74e42325d assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] check if targe iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] create target and attach volume 09a4582c-404d-4225-baf5-59b74e42325d to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] create target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] atach volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 to target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:18:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3463366364646231', 'lun': 0, 'mode': 'wt', 'name': 'v_b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'prod_id': 'Storage', 'scsi_id': '4c6cddb1461e2abb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] add credentails to target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:18:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'name': 'mfOroQgL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] initialize_connection for b7e94002-3eeb-442d-b224-ef83dacfa5a4 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:18:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfOroQgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'f57596f4-3157-4f5b-b9aa-52470f8dbf1c'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:18:34 user cinder-volume[73393]: INFO cinder.volume.manager [req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 req-6c165283-d872-438b-bcbe-da6a42ee68fb tempest-AttachVolumeTestJSON-991906288 None] attachment_update completed successfully. Apr 14 04:18:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] atach volume v_09a4582c-404d-4225-baf5-59b74e42325d to target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:18:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6232393833383461', 'lun': 0, 'mode': 'wt', 'name': 'v_09a4582c-404d-4225-baf5-59b74e42325d', 'prod_id': 'Storage', 'scsi_id': 'b298384ab1883648'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] add credentails to target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:18:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 201, 'error': None, 'data': {'name': 'UAXqaniM'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] initialize_connection for 09a4582c-404d-4225-baf5-59b74e42325d 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:18:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAXqaniM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '7ae45d61-2bc7-4ef5-8288-3215872da780'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:18:36 user cinder-volume[73393]: INFO cinder.volume.manager [req-02b363a5-ff13-4502-8b19-110d6817aab6 req-f4330e86-c975-47f5-9cc6-bbe0dfaf4170 tempest-DeleteServersTestJSON-2046031715 None] attachment_update completed successfully. Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] terminate connection for 09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:18:41 user cinder-volume[73393]: INFO cinder.volume.manager [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Terminate volume connection completed successfully. Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Deleting attachment 7ae45d61-2bc7-4ef5-8288-3215872da780. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] remove_export for volume: 09a4582c-404d-4225-baf5-59b74e42325d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-339573791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=09a4582c-404d-4225-baf5-59b74e42325d,launched_at=2023-04-14T04:18:30Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ce5e634f187b470085e7bfb3c1cfcbe7',provider_auth='CHAP UAXqaniM TXbHnLvIlmSMrK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:29Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:18:39Z,use_quota=True,user_id='fab852bb302f44b1af63083c99ea244c',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] detach volume v_09a4582c-404d-4225-baf5-59b74e42325d from target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] delete target: iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] delete target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-895a79f1-1033-4bb2-b419-a92316f9bcf4 req-3b2371d5-ed86-421f-ae5d-4319b23afc17 tempest-DeleteServersTestJSON-2046031715 None] target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Flow 'volume_create_manager' (4f16c650-62f5-4ac7-992b-382e7140c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220f3b32-78da-4594-89ff-61664f64f7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220f3b32-78da-4594-89ff-61664f64f7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1260215246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9c5e5b34-a82b-4011-88cb-968010ef59f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e636ba0ee9486f9f48905d886ab547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:18:54Z,use_quota=True,user_id='d1b09bc7a0344ae782d33d3222a8ea88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2f268f-ce56-4970-8849-88679cd62fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2f268f-ce56-4970-8849-88679cd62fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94f9a60-c035-40b8-bd2d-c2cc77473273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94f9a60-c035-40b8-bd2d-c2cc77473273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5e5b34-a82b-4011-88cb-968010ef59f9', 'volume_name': 'volume-9c5e5b34-a82b-4011-88cb-968010ef59f9', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5081bf-8fbc-40c9-9aee-88de87d5b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5081bf-8fbc-40c9-9aee-88de87d5b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63e3bdd-d068-4ea4-94c5-68afb1f0a2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Volume 9c5e5b34-a82b-4011-88cb-968010ef59f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5e5b34-a82b-4011-88cb-968010ef59f9', 'volume_size': 1} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] creating volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] create volume {'name': 'v_9c5e5b34-a82b-4011-88cb-968010ef59f9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9c5e5b34-a82b-4011-88cb-968010ef59f9', 'is_clone': False, 'name': 'v_9c5e5b34-a82b-4011-88cb-968010ef59f9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63e3bdd-d068-4ea4-94c5-68afb1f0a2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5e5b34-a82b-4011-88cb-968010ef59f9', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4665718b-03d0-497b-914d-c8296e7ab650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:18:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Volume volume-9c5e5b34-a82b-4011-88cb-968010ef59f9 (9c5e5b34-a82b-4011-88cb-968010ef59f9): created successfully Apr 14 04:18:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4665718b-03d0-497b-914d-c8296e7ab650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:18:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Flow 'volume_create_manager' (4f16c650-62f5-4ac7-992b-382e7140c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:18:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3b9b6e13-f534-4752-bf50-8b2016746459 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Created volume successfully. Apr 14 04:18:56 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=9,cinder:SELECT=45,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] create export for volume: 9c5e5b34-a82b-4011-88cb-968010ef59f9. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] ensure volume 9c5e5b34-a82b-4011-88cb-968010ef59f9 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] check if targe iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] create target and attach volume 9c5e5b34-a82b-4011-88cb-968010ef59f9 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] create target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:18:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:18:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] atach volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9 to target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:18:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:18:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=36,cinder:UPDATE=13 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] create export for volume: 80a9f7e6-e364-4c2b-9814-96061ad47dd6. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] ensure volume 80a9f7e6-e364-4c2b-9814-96061ad47dd6 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] check if targe iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] create target and attach volume 80a9f7e6-e364-4c2b-9814-96061ad47dd6 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] create target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3162393337373236', 'lun': 0, 'mode': 'wt', 'name': 'v_9c5e5b34-a82b-4011-88cb-968010ef59f9', 'prod_id': 'Storage', 'scsi_id': '1b937726a26a47c7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] add credentails to target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:19:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 201, 'error': None, 'data': {'name': 'SLYEVqyw'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] initialize_connection for 9c5e5b34-a82b-4011-88cb-968010ef59f9 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:19:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLYEVqyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '118396e2-4525-4f28-82cd-bb5ee6ba211a'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:19:01 user cinder-volume[73393]: INFO cinder.volume.manager [req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 req-8686c2cd-fdb5-4a65-a227-e995e91a93ca tempest-AttachSCSIVolumeTestJSON-1503158328 None] attachment_update completed successfully. Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] atach volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 to target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] create export for volume: f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] ensure volume f3255f25-0334-46dd-a514-12a56a1deffd assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] check if targe iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] create target and attach volume f3255f25-0334-46dd-a514-12a56a1deffd to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] create target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3463366236626563', 'lun': 0, 'mode': 'wt', 'name': 'v_80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'prod_id': 'Storage', 'scsi_id': '4c6b6bec76a3edfa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] add credentails to target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:19:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 201, 'error': None, 'data': {'name': 'NtrRMlgi'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] initialize_connection for 80a9f7e6-e364-4c2b-9814-96061ad47dd6 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:19:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtrRMlgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5113dbff-bf3f-49bc-87bc-94ce948ef193'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:19:05 user cinder-volume[73393]: INFO cinder.volume.manager [req-d6a8c013-14c2-49e1-8cc1-32a009845707 req-08890bac-711f-45e3-9a6a-7527530998b6 tempest-TaggedAttachmentsTest-926384577 None] attachment_update completed successfully. Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] atach volume v_f3255f25-0334-46dd-a514-12a56a1deffd to target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] terminate connection for 9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:06 user cinder-volume[73393]: INFO cinder.volume.manager [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Terminate volume connection completed successfully. Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Deleting attachment 118396e2-4525-4f28-82cd-bb5ee6ba211a. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] remove_export for volume: 9c5e5b34-a82b-4011-88cb-968010ef59f9. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1260215246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9c5e5b34-a82b-4011-88cb-968010ef59f9,launched_at=2023-04-14T04:18:55Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='e0e636ba0ee9486f9f48905d886ab547',provider_auth='CHAP SLYEVqyw UyHAJ1BTj0fD7S',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:19:05Z,use_quota=True,user_id='d1b09bc7a0344ae782d33d3222a8ea88',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] detach volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9 from target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] delete target: iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] delete target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a576016a-f803-48c8-9e25-e783e410bdf5 req-09c2f679-73fe-4cef-a926-eaee0130a4e5 tempest-AttachSCSIVolumeTestJSON-1503158328 None] target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3330303765366434', 'lun': 0, 'mode': 'wt', 'name': 'v_f3255f25-0334-46dd-a514-12a56a1deffd', 'prod_id': 'Storage', 'scsi_id': '3007e6d4cb2b44fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] add credentails to target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:19:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PuAKITjr'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] initialize_connection for f3255f25-0334-46dd-a514-12a56a1deffd 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:19:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuAKITjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '92fba555-68e3-43bf-963d-49e70696a603'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:19:08 user cinder-volume[73393]: INFO cinder.volume.manager [req-9369e401-f616-43aa-82ff-882f10e94f56 req-9c0dfd1a-a617-4632-b5d7-3b6d98b49562 tempest-TestVolumeSwap-926061730 None] attachment_update completed successfully. Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] terminate connection for 80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:10 user cinder-volume[73393]: INFO cinder.volume.manager [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Terminate volume connection completed successfully. Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Deleting attachment 5113dbff-bf3f-49bc-87bc-94ce948ef193. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] remove_export for volume: 80a9f7e6-e364-4c2b-9814-96061ad47dd6. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1539333457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80a9f7e6-e364-4c2b-9814-96061ad47dd6,launched_at=2023-04-14T04:16:57Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='01cefa66350a4432ad71204b39e953be',provider_auth='CHAP NtrRMlgi lpjDPCEoQ3FGm4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:55Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:19:09Z,use_quota=True,user_id='0aeeeae7cbc340daa8cd81c1418794e0',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] detach volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 from target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] delete target: iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] delete target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 req-e4ba2ea8-0f61-4f8c-8c10-6b83931a3de0 tempest-TaggedAttachmentsTest-926384577 None] target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] create export for volume: eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] ensure volume eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] check if targe iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] create target and attach volume eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] create target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] atach volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 to target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:19:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6238353462303336', 'lun': 0, 'mode': 'wt', 'name': 'v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'prod_id': 'Storage', 'scsi_id': 'b854b0363086588c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] add credentails to target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:19:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Geting {'code': 201, 'error': None, 'data': {'name': 'GcuPjMLZ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] initialize_connection for eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:19:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcuPjMLZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a180602f-c69a-4f73-9bb5-210d716aec55'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:19:16 user cinder-volume[73393]: INFO cinder.volume.manager [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-b0a24b6c-7439-4087-888b-d3a9cf9438bb tempest-TestVolumeSwap-117798025 None] attachment_update completed successfully. Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] terminate connection for f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:22 user cinder-volume[73393]: INFO cinder.volume.manager [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Terminate volume connection completed successfully. Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Deleting attachment 92fba555-68e3-43bf-963d-49e70696a603. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] remove_export for volume: f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1291039934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f3255f25-0334-46dd-a514-12a56a1deffd,launched_at=2023-04-14T04:17:04Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ffadee5eeb7f4b42ae93e2e2578ef897',provider_auth='CHAP PuAKITjr 51syx2hVFSmOTK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:03Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:19:11Z,use_quota=True,user_id='1da030e7c9e44f9b82f3286378a2ede6',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] detach volume v_f3255f25-0334-46dd-a514-12a56a1deffd from target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] delete target: iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] delete target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 req-d19df745-b3ac-4f2b-ba25-d624c987c6e0 tempest-TestVolumeSwap-117798025 None] target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] create export for volume: f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] ensure volume f3255f25-0334-46dd-a514-12a56a1deffd assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] check if targe iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] create target and attach volume f3255f25-0334-46dd-a514-12a56a1deffd to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] create target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114248966144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:19:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:19:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] atach volume v_f3255f25-0334-46dd-a514-12a56a1deffd to target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:19:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=53,cinder:UPDATE=10 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3330303765366434', 'lun': 0, 'mode': 'wt', 'name': 'v_f3255f25-0334-46dd-a514-12a56a1deffd', 'prod_id': 'Storage', 'scsi_id': '3007e6d4cb2b44fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] add credentails to target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:19:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PuAKITjr'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] initialize_connection for f3255f25-0334-46dd-a514-12a56a1deffd 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:19:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuAKITjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '390b336c-ff30-43de-b2e8-acbd0f195610'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:19:28 user cinder-volume[73393]: INFO cinder.volume.manager [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-d7674888-87ef-4014-b71a-e822c6e2ee7b tempest-TestVolumeSwap-117798025 None] attachment_update completed successfully. Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Acquiring lock "cinder-09a4582c-404d-4225-baf5-59b74e42325d-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Lock "cinder-09a4582c-404d-4225-baf5-59b74e42325d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] remove_export for volume: 09a4582c-404d-4225-baf5-59b74e42325d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-339573791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=09a4582c-404d-4225-baf5-59b74e42325d,launched_at=2023-04-14T04:18:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5e634f187b470085e7bfb3c1cfcbe7',provider_auth='CHAP UAXqaniM TXbHnLvIlmSMrK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:29Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:19:30Z,updated_at=2023-04-14T04:19:30Z,use_quota=True,user_id='fab852bb302f44b1af63083c99ea244c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] detach volume v_09a4582c-404d-4225-baf5-59b74e42325d from target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns/v_09a4582c-404d-4225-baf5-59b74e42325d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d/luns/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] failed to remove resource iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d because of JDSS resource v_09a4582c-404d-4225-baf5-59b74e42325d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] delete target: iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] delete target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] failed to remove resource iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d because of JDSS resource iqn.2010-10.org.openstack:09a4582c-404d-4225-baf5-59b74e42325d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] deleating volume v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] get snapshots for volume v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] get volume v_09a4582c-404d-4225-baf5-59b74e42325d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_09a4582c-404d-4225-baf5-59b74e42325d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447318', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114867', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5181858511175163741', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b298384ab1883648', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248966144', 'san:volume_id': 'b298384ab188364883ed4b1632393b3264678136', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87756', 'name': 'v_09a4582c-404d-4225-baf5-59b74e42325d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] delete volume:v_09a4582c-404d-4225-baf5-59b74e42325d recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_09a4582c-404d-4225-baf5-59b74e42325d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] volume v_09a4582c-404d-4225-baf5-59b74e42325d deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=67,cinder:UPDATE=11 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG cinder.quota [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Created reservations ['d518d8ac-dab6-47ff-a5b8-55fd669a3891', '13155800-9e52-41d3-b4ae-d5e29ae6835c', '3487d0aa-27ff-4cbe-add7-2a695fe1b227', 'bd532ee4-991f-4caf-9a6e-85bec9ce2061'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Geting {'code': 200, 'error': None, 'data': {'available': '114249011200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:19:33 user cinder-volume[73393]: DEBUG cinder.manager [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:19:33 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Deleted volume successfully. Apr 14 04:19:33 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a76521b5-d8ae-47fe-b6d2-d32709903ecd tempest-DeleteServersTestJSON-2046031715 None] Lock "cinder-09a4582c-404d-4225-baf5-59b74e42325d-delete_volume" released by "delete_volume" :: held 4.106s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] terminate connection for eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:36 user cinder-volume[73393]: INFO cinder.volume.manager [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Terminate volume connection completed successfully. Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Deleting attachment a180602f-c69a-4f73-9bb5-210d716aec55. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] remove_export for volume: eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-24781138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370,launched_at=2023-04-14T04:17:07Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ffadee5eeb7f4b42ae93e2e2578ef897',provider_auth='CHAP GcuPjMLZ MgPp9wXI7yqnUY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:06Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:19:24Z,use_quota=True,user_id='1da030e7c9e44f9b82f3286378a2ede6',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] detach volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 from target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] delete target: iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] delete target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b832fbb5-91ab-4a5e-a1b5-b07052007feb req-508c11ef-afe0-4f39-be01-69da267b9beb tempest-TestVolumeSwap-117798025 None] target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] terminate connection for f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:39 user cinder-volume[73393]: INFO cinder.volume.manager [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Terminate volume connection completed successfully. Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Deleting attachment 390b336c-ff30-43de-b2e8-acbd0f195610. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] remove_export for volume: f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1291039934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f3255f25-0334-46dd-a514-12a56a1deffd,launched_at=2023-04-14T04:17:04Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ffadee5eeb7f4b42ae93e2e2578ef897',provider_auth='CHAP PuAKITjr 51syx2hVFSmOTK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:03Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:19:38Z,use_quota=True,user_id='1da030e7c9e44f9b82f3286378a2ede6',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] detach volume v_f3255f25-0334-46dd-a514-12a56a1deffd from target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] delete target: iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] delete target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b3742b90-6cb5-448d-a7b9-50727360ccc6 req-d981b3a6-4424-43a4-b091-9651a611ebe0 tempest-TestVolumeSwap-926061730 None] target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] terminate connection for 31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:44 user cinder-volume[73393]: INFO cinder.volume.manager [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Terminate volume connection completed successfully. Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Deleting attachment e342f29f-eaa0-4d55-bbe5-e2dd4fd88e97. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] remove_export for volume: 31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-224844915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=31382528-1966-4f19-8a4a-94983a6314c3,launched_at=2023-04-14T04:17:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth='CHAP ZFpuzxGw 4P9UZf5KuYplTQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:58Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:17:50Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume v_31382528-1966-4f19-8a4a-94983a6314c3 from target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] delete target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] delete target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-a3ba6c85-7cad-4144-a25d-7bd11a55844b tempest-TaggedBootDevicesTest_v242-581315356 None] target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] terminate connection for 18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:44 user cinder-volume[73393]: INFO cinder.volume.manager [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Terminate volume connection completed successfully. Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Deleting attachment e2915d95-5bab-4b56-bc25-4f938db97e78. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] remove_export for volume: 18016742-a15a-4e85-9fb9-4cbfd819316b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1908156496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=18016742-a15a-4e85-9fb9-4cbfd819316b,launched_at=2023-04-14T04:17:27Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth='CHAP nQRoZmkl Yd7A8B1x5HbT6E',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:26Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:17:54Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume v_18016742-a15a-4e85-9fb9-4cbfd819316b from target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target: iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-461b2afd-2983-402a-bd49-adb9cc10ddb1 tempest-TaggedBootDevicesTest_v242-581315356 None] target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] terminate connection for c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:19:45 user cinder-volume[73393]: INFO cinder.volume.manager [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Terminate volume connection completed successfully. Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Deleting attachment a062bc6d-16a2-4670-acaf-78b62d1dfd90. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] remove_export for volume: c8315093-aba5-4adf-8381-c59806b42282. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1888583181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c8315093-aba5-4adf-8381-c59806b42282,launched_at=2023-04-14T04:17:30Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth='CHAP HjUKqOuQ R8TuoqbBk7lz6W',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:29Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:17:59Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume v_c8315093-aba5-4adf-8381-c59806b42282 from target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target: iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Flow 'volume_create_manager' (6f966dff-7a4d-49dd-94a4-05be215d3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f474d07e-10ea-409d-9583-411479cd169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc9f897b-1670-4413-81a6-b50aae1af03b req-86a465c3-a933-4cd0-a9d1-9a40d074e972 tempest-TaggedBootDevicesTest_v242-581315356 None] target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f474d07e-10ea-409d-9583-411479cd169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1673433759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=70317b0d-2515-45ac-825b-207626822497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a60f60717b44f4ba904a949eabfe608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:19:46Z,use_quota=True,user_id='982f167333954612a51911fc8d6c1ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d25ae0-3d26-4b8d-95f4-73bcd291266d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d25ae0-3d26-4b8d-95f4-73bcd291266d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3c0954-36c3-4742-9096-131569640200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3c0954-36c3-4742-9096-131569640200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70317b0d-2515-45ac-825b-207626822497', 'volume_name': 'volume-70317b0d-2515-45ac-825b-207626822497', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8071a54-a945-437f-86e3-057a1a5208dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8071a54-a945-437f-86e3-057a1a5208dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47eb66ee-5564-4be1-881a-1defc8fea935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:46 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Volume 70317b0d-2515-45ac-825b-207626822497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70317b0d-2515-45ac-825b-207626822497', 'volume_size': 1} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] creating volume v_70317b0d-2515-45ac-825b-207626822497. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] create volume {'name': 'v_70317b0d-2515-45ac-825b-207626822497', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_70317b0d-2515-45ac-825b-207626822497', 'is_clone': False, 'name': 'v_70317b0d-2515-45ac-825b-207626822497'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47eb66ee-5564-4be1-881a-1defc8fea935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70317b0d-2515-45ac-825b-207626822497', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a394929-3131-479e-adef-e5b0cee7edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:47 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Volume volume-70317b0d-2515-45ac-825b-207626822497 (70317b0d-2515-45ac-825b-207626822497): created successfully Apr 14 04:19:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a394929-3131-479e-adef-e5b0cee7edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Flow 'volume_create_manager' (6f966dff-7a4d-49dd-94a4-05be215d3e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:19:47 user cinder-volume[73393]: INFO cinder.volume.manager [None req-13ceae6a-fa03-48e7-b82a-f49a312f1fac tempest-TestMinimumBasicScenario-1872250892 None] Created volume successfully. Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] create export for volume: 70317b0d-2515-45ac-825b-207626822497. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] ensure volume 70317b0d-2515-45ac-825b-207626822497 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] check if targe iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] create target and attach volume 70317b0d-2515-45ac-825b-207626822497 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] create target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] atach volume v_70317b0d-2515-45ac-825b-207626822497 to target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:19:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3133643332343064', 'lun': 0, 'mode': 'wt', 'name': 'v_70317b0d-2515-45ac-825b-207626822497', 'prod_id': 'Storage', 'scsi_id': '13d3240d44872563'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] add credentails to target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:19:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HkOfdlri'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] initialize_connection for 70317b0d-2515-45ac-825b-207626822497 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:19:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkOfdlri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ff3d8abd-b66f-43ca-baed-8c5b606bd22b'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:19:53 user cinder-volume[73393]: INFO cinder.volume.manager [req-ebc290f9-6648-4d11-bda1-1a8ae965d20c req-4706f860-a768-4138-8bb4-17f9b5f0833f tempest-TestMinimumBasicScenario-1872250892 None] attachment_update completed successfully. Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Flow 'volume_create_manager' (e5184fee-cc49-40d4-be25-77d51a06a553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d443ac-4719-41bb-8411-552c1ff5f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d443ac-4719-41bb-8411-552c1ff5f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2019879053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f2d01790-bd9f-4eff-aa4d-2248429aeb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:19:54Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2fc44d-37c0-4973-8b10-d13645d859a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2fc44d-37c0-4973-8b10-d13645d859a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553efd00-afff-41eb-b3f3-812ebc8bbb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553efd00-afff-41eb-b3f3-812ebc8bbb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'volume_name': 'volume-f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3fce5b-b900-48bf-8710-4519a0b2f01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3fce5b-b900-48bf-8710-4519a0b2f01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65761e7-80ec-4449-afb5-7d594c4f9cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Volume f2d01790-bd9f-4eff-aa4d-2248429aeb94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Cloning f2d01790-bd9f-4eff-aa4d-2248429aeb94 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 19, 54, 215530)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 19, 54, 228938)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] create snapshot v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_f2d01790-bd9f-4eff-aa4d-2248429aeb94'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] create volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 from snapshot v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:19:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'is_clone': True, 'full_name': 'Pool-0/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'name': 'v_f2d01790-bd9f-4eff-aa4d-2248429aeb94'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] get volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447404', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '114945', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13982922437952156039', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '232cba263dfbb5b8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248880128', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87771', 'name': 'v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Marking volume f2d01790-bd9f-4eff-aa4d-2248429aeb94 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to f2d01790-bd9f-4eff-aa4d-2248429aeb94. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Creating volume glance metadata for volume f2d01790-bd9f-4eff-aa4d-2248429aeb94 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65761e7-80ec-4449-afb5-7d594c4f9cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5202de-ea30-4a47-b5bb-ad19ea6ba246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:56 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Volume volume-f2d01790-bd9f-4eff-aa4d-2248429aeb94 (f2d01790-bd9f-4eff-aa4d-2248429aeb94): created successfully Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5202de-ea30-4a47-b5bb-ad19ea6ba246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Flow 'volume_create_manager' (e5184fee-cc49-40d4-be25-77d51a06a553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:19:56 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c1114ae7-2c9e-404b-bff8-2922a0e77c1a tempest-TaggedBootDevicesTest-914882220 None] Created volume successfully. Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] create snapshot 2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 for volume 70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] cloning v_70317b0d-2515-45ac-825b-207626822497 to s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] create snapshot s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Flow 'volume_create_manager' (640b5cfa-1185-4fd8-b078-e619dfbf9699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4034932e-ea50-4cfb-9105-20b7b71d7c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4034932e-ea50-4cfb-9105-20b7b71d7c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2144330636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=40e8dfdd-c6e4-4f7f-a465-913fe79829ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:19:58Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c032cfe1-2546-4635-9f76-d6a3b846a0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c032cfe1-2546-4635-9f76-d6a3b846a0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c87aea-b50f-4ed5-b14c-9837004a655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c87aea-b50f-4ed5-b14c-9837004a655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'volume_name': 'volume-40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9197eaa0-2419-4491-83cc-ed2383e42e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9197eaa0-2419-4491-83cc-ed2383e42e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1128ac9d-4fe9-4ae8-98e6-6563e4b3e19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:57 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Volume 40e8dfdd-c6e4-4f7f-a465-913fe79829ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'volume_size': 1} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] creating volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] create volume {'name': 'v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=77,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] create volume s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 from snapshot s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'is_clone': False, 'name': 'v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1128ac9d-4fe9-4ae8-98e6-6563e4b3e19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cc40a7-6c75-4037-92d7-eb51d2e4e52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:19:58 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Volume volume-40e8dfdd-c6e4-4f7f-a465-913fe79829ac (40e8dfdd-c6e4-4f7f-a465-913fe79829ac): created successfully Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cc40a7-6c75-4037-92d7-eb51d2e4e52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Flow 'volume_create_manager' (640b5cfa-1185-4fd8-b078-e619dfbf9699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:19:58 user cinder-volume[73393]: INFO cinder.volume.manager [None req-44524176-04ac-4592-a3b1-e48f6342c1a1 tempest-TaggedBootDevicesTest-914882220 None] Created volume successfully. Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_70317b0d-2515-45ac-825b-207626822497@s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0', 'is_clone': True, 'full_name': 'Pool-0/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0', 'name': 's_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] volume s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:19:59 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c8aabb53-b1d9-4495-8236-f3d0ab5aa2f6 tempest-TestMinimumBasicScenario-1872250892 None] Create snapshot completed successfully Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.coordination [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Acquiring lock "cinder-9c5e5b34-a82b-4011-88cb-968010ef59f9-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.coordination [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Lock "cinder-9c5e5b34-a82b-4011-88cb-968010ef59f9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=59,cinder:INSERT=14,cinder:UPDATE=23,cinder:DELETE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] remove_export for volume: 9c5e5b34-a82b-4011-88cb-968010ef59f9. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1260215246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9c5e5b34-a82b-4011-88cb-968010ef59f9,launched_at=2023-04-14T04:18:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e636ba0ee9486f9f48905d886ab547',provider_auth='CHAP SLYEVqyw UyHAJ1BTj0fD7S',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:20:00Z,updated_at=2023-04-14T04:20:00Z,use_quota=True,user_id='d1b09bc7a0344ae782d33d3222a8ea88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] detach volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9 from target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns/v_9c5e5b34-a82b-4011-88cb-968010ef59f9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9/luns/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] failed to remove resource iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 because of JDSS resource v_9c5e5b34-a82b-4011-88cb-968010ef59f9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] delete target: iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] delete target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] failed to remove resource iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 because of JDSS resource iqn.2010-10.org.openstack:9c5e5b34-a82b-4011-88cb-968010ef59f9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] deleating volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] get snapshots for volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:19:59 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Flow 'volume_create_manager' (a45aa9d6-0211-4f18-bee3-409281570d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f90193-5593-45ef-85f3-6f3b9d8d6991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f90193-5593-45ef-85f3-6f3b9d8d6991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-314191079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e5988ce-8d0a-49a0-acc8-84f7d3917bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:20:00Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd2adfe-4f38-4e55-9b7f-33648f25e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd2adfe-4f38-4e55-9b7f-33648f25e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f54c36d-bd26-4167-8e42-053af8227548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f54c36d-bd26-4167-8e42-053af8227548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'volume_name': 'volume-5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd292a0f-dad7-4e21-95f6-2ed13cfcc87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd292a0f-dad7-4e21-95f6-2ed13cfcc87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d20c249-02fe-4a5b-873f-c354fa2f723a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:00 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Volume 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'volume_size': 1} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] creating volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] create volume {'name': 'v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] get volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9c5e5b34-a82b-4011-88cb-968010ef59f9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447343', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114882', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4095584783800132464', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1b937726a26a47c7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248749056', 'san:volume_id': '1b937726a26a47c7187f1c1280659b9d9ce5960d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86481', 'name': 'v_9c5e5b34-a82b-4011-88cb-968010ef59f9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] delete volume:v_9c5e5b34-a82b-4011-88cb-968010ef59f9 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'is_clone': False, 'name': 'v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d20c249-02fe-4a5b-873f-c354fa2f723a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e57aa8c-1a1e-42b5-98a1-de893e4e8252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:01 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Volume volume-5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 (5e5988ce-8d0a-49a0-acc8-84f7d3917bd3): created successfully Apr 14 04:20:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e57aa8c-1a1e-42b5-98a1-de893e4e8252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Flow 'volume_create_manager' (a45aa9d6-0211-4f18-bee3-409281570d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:20:01 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e1d47584-67ae-4446-9669-3a59d0495206 tempest-TaggedBootDevicesTest-914882220 None] Created volume successfully. Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9c5e5b34-a82b-4011-88cb-968010ef59f9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] volume v_9c5e5b34-a82b-4011-88cb-968010ef59f9 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.quota [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Created reservations ['77344c35-1fd1-4bc8-9493-bbe918ab64ca', 'b9d6acd7-713a-4e96-b41d-0b4fa8fce7bd', '425750e9-91f4-4bb5-96a1-87d4b7497677', '3a271b06-902c-470e-a331-8bbdc50d4525'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248736768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:20:02 user cinder-volume[73393]: DEBUG cinder.manager [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:20:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Deleted volume successfully. Apr 14 04:20:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-94ec5a0f-e51a-421b-aa05-3fd08b5783e7 tempest-AttachSCSIVolumeTestJSON-1503158328 None] Lock "cinder-9c5e5b34-a82b-4011-88cb-968010ef59f9-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:20:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Acquiring lock "cinder-2ff1f714-b479-4e3f-8ae5-07972c3cb1f0-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:20:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Lock "cinder-2ff1f714-b479-4e3f-8ae5-07972c3cb1f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:20:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] deleating snapshot s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:20:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] get snapshots for volume s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:20:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] get volume s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_70317b0d-2515-45ac-825b-207626822497@s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447406', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114951', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16234128830275891261', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3c85c4485bea36bc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248736768', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87133', 'name': 's_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] delete snapshot s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 of volume v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots/s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] snapshot s_2ff1f714-b479-4e3f-8ae5-07972c3cb1f0 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:20:08 user cinder-volume[73393]: WARNING cinder.quota [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Deprecated: Default quota for resource: snapshots_joviandss-2 is set by the default quota flag: quota_snapshots_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:20:08 user cinder-volume[73393]: DEBUG cinder.quota [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Created reservations ['e8a67b33-0068-47dc-a3b2-cd8e2a136729', '64f6d54b-0d31-416f-905f-58bc518be33a', '51877732-d7f3-4011-a844-bde119df75e0', '31b36335-a657-4228-8b9a-e492bd3716eb'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:20:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Delete snapshot completed successfully. Apr 14 04:20:08 user cinder-volume[73393]: DEBUG cinder.coordination [None req-acf4d314-a2bf-4470-b587-50f88d819930 tempest-TestMinimumBasicScenario-1872250892 None] Lock "cinder-2ff1f714-b479-4e3f-8ae5-07972c3cb1f0-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] create export for volume: f2d01790-bd9f-4eff-aa4d-2248429aeb94. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] ensure volume f2d01790-bd9f-4eff-aa4d-2248429aeb94 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] check if targe iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] create target and attach volume f2d01790-bd9f-4eff-aa4d-2248429aeb94 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] create target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] atach volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 to target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:20:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3233326362613236', 'lun': 0, 'mode': 'wt', 'name': 'v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'prod_id': 'Storage', 'scsi_id': '232cba263dfbb5b8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] add credentails to target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:20:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'name': 'FdyQafHs'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] initialize_connection for f2d01790-bd9f-4eff-aa4d-2248429aeb94 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdyQafHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '6510384b-b7d8-458c-8e4c-bc14aa6c7bd4'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:20:21 user cinder-volume[73393]: INFO cinder.volume.manager [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-e9586f3b-c9c9-414a-8cf8-b763c68ca00f tempest-TaggedBootDevicesTest-914882220 None] attachment_update completed successfully. Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] create export for volume: 40e8dfdd-c6e4-4f7f-a465-913fe79829ac. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] ensure volume 40e8dfdd-c6e4-4f7f-a465-913fe79829ac assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] check if targe iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] create target and attach volume 40e8dfdd-c6e4-4f7f-a465-913fe79829ac to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] create target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] atach volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac to target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114248736768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3730313961363466', 'lun': 0, 'mode': 'wt', 'name': 'v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'prod_id': 'Storage', 'scsi_id': '7019a64fc4faca71'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] add credentails to target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'name': 'aEOFgACW'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] initialize_connection for 40e8dfdd-c6e4-4f7f-a465-913fe79829ac 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEOFgACW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'c67610e7-bec4-4bc4-966e-21da3a7669f1'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:20:26 user cinder-volume[73393]: INFO cinder.volume.manager [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-05d661b3-03b5-4c70-90af-7d98bb325b7f tempest-TaggedBootDevicesTest-914882220 None] attachment_update completed successfully. Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] create export for volume: 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] ensure volume 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] check if targe iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] create target and attach volume 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] create target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Flow 'volume_create_manager' (6fc186b3-8eb4-4729-972c-d261aaf3fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a33376-c259-4b77-8552-eaa801bde930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a33376-c259-4b77-8552-eaa801bde930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1183423330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3e0082ad-1ad0-4980-a066-6017f65fce9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:20:27Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e41c883-5b2b-43e2-9066-cf48577a168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e41c883-5b2b-43e2-9066-cf48577a168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5242cf5-b2a8-4df0-bc91-00af8661fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5242cf5-b2a8-4df0-bc91-00af8661fe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0082ad-1ad0-4980-a066-6017f65fce9e', 'volume_name': 'volume-3e0082ad-1ad0-4980-a066-6017f65fce9e', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2755e892-3226-446f-9f48-86cdcca2170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2755e892-3226-446f-9f48-86cdcca2170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b158b7-ce66-4e55-a9de-11bcb8abe93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:26 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Volume 3e0082ad-1ad0-4980-a066-6017f65fce9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0082ad-1ad0-4980-a066-6017f65fce9e', 'volume_size': 1} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] creating volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] create volume {'name': 'v_3e0082ad-1ad0-4980-a066-6017f65fce9e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=24,cinder:SELECT=70,cinder:DELETE=1,cinder:INSERT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3e0082ad-1ad0-4980-a066-6017f65fce9e', 'is_clone': False, 'name': 'v_3e0082ad-1ad0-4980-a066-6017f65fce9e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b158b7-ce66-4e55-a9de-11bcb8abe93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0082ad-1ad0-4980-a066-6017f65fce9e', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661cd8f3-2e41-4465-8abe-61e34d5604b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Volume volume-3e0082ad-1ad0-4980-a066-6017f65fce9e (3e0082ad-1ad0-4980-a066-6017f65fce9e): created successfully Apr 14 04:20:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661cd8f3-2e41-4465-8abe-61e34d5604b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Flow 'volume_create_manager' (6fc186b3-8eb4-4729-972c-d261aaf3fc73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:20:27 user cinder-volume[73393]: INFO cinder.volume.manager [None req-afe65f11-9374-4c2c-9646-99f1f4210664 tempest-ServerActionsTestJSON-1048786641 None] Created volume successfully. Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] atach volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 to target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=49,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] create export for volume: 3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] ensure volume 3e0082ad-1ad0-4980-a066-6017f65fce9e assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] check if targe iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] create target and attach volume 3e0082ad-1ad0-4980-a066-6017f65fce9e to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] create target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6235613263376464', 'lun': 0, 'mode': 'wt', 'name': 'v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'prod_id': 'Storage', 'scsi_id': 'b5a2c7dde4fad581'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] add credentails to target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:20:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 201, 'error': None, 'data': {'name': 'WspLiGZN'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] initialize_connection for 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:20:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WspLiGZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4259a8d9-79de-44fa-afcc-18b419dfaf6c'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:20:32 user cinder-volume[73393]: INFO cinder.volume.manager [req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 req-c72a79a2-1e79-4031-a1ee-7fe8570c6774 tempest-TaggedBootDevicesTest-914882220 None] attachment_update completed successfully. Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Acquiring lock "cinder-c8315093-aba5-4adf-8381-c59806b42282-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-c8315093-aba5-4adf-8381-c59806b42282-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] remove_export for volume: c8315093-aba5-4adf-8381-c59806b42282. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1888583181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c8315093-aba5-4adf-8381-c59806b42282,launched_at=2023-04-14T04:17:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth='CHAP HjUKqOuQ R8TuoqbBk7lz6W',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:29Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:20:33Z,updated_at=2023-04-14T04:20:33Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume v_c8315093-aba5-4adf-8381-c59806b42282 from target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns/v_c8315093-aba5-4adf-8381-c59806b42282'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282/luns/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] failed to remove resource iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 because of JDSS resource v_c8315093-aba5-4adf-8381-c59806b42282 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target: iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] delete target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] failed to remove resource iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 because of JDSS resource iqn.2010-10.org.openstack:c8315093-aba5-4adf-8381-c59806b42282 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] deleating volume v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] get snapshots for volume v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Flow 'volume_create_manager' (d18a7750-aa64-411f-a61b-f80495f7cbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e89c26-4775-48d9-b848-3bf9a46baba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e89c26-4775-48d9-b848-3bf9a46baba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1879579168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bb9ddec81e4f6cbceb6ce7dee9c3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:20:33Z,use_quota=True,user_id='676d80d3684045298d895555247174af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9691d46-272d-40ae-a564-410e31e438cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9691d46-272d-40ae-a564-410e31e438cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983b9cd-9387-43e2-8c9e-41736763bf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983b9cd-9387-43e2-8c9e-41736763bf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'volume_name': 'volume-3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe996a5-88e1-4f47-a76a-69ea9ea24c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe996a5-88e1-4f47-a76a-69ea9ea24c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d13d06-626f-499e-aa5c-a4532abc2e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:33 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Volume 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'volume_size': 1} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] creating volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] create volume {'name': 'v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] atach volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e to target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] get volume v_c8315093-aba5-4adf-8381-c59806b42282 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c8315093-aba5-4adf-8381-c59806b42282', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447258', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114838', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9417126825096170709', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0bf372a81c5382c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248654848', 'san:volume_id': '0bf372a81c5382c89baf3710b524766c60599619', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87851', 'name': 'v_c8315093-aba5-4adf-8381-c59806b42282', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] delete volume:v_c8315093-aba5-4adf-8381-c59806b42282 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'is_clone': False, 'name': 'v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d13d06-626f-499e-aa5c-a4532abc2e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1432f09f-dbee-467f-9527-fdcc4296f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:20:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Volume volume-3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5): created successfully Apr 14 04:20:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1432f09f-dbee-467f-9527-fdcc4296f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:20:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Flow 'volume_create_manager' (d18a7750-aa64-411f-a61b-f80495f7cbff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:20:35 user cinder-volume[73393]: INFO cinder.volume.manager [None req-da714af1-ec18-4b60-b3d3-d74e6aafeb29 tempest-ServerStableDeviceRescueTest-1018370864 None] Created volume successfully. Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3362346236663531', 'lun': 0, 'mode': 'wt', 'name': 'v_3e0082ad-1ad0-4980-a066-6017f65fce9e', 'prod_id': 'Storage', 'scsi_id': '3b4b6f51086736b8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] add credentails to target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YjWqRKtu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] initialize_connection for 3e0082ad-1ad0-4980-a066-6017f65fce9e 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjWqRKtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4372af92-6441-4463-9a7f-3e4c116e5a00'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:20:36 user cinder-volume[73393]: INFO cinder.volume.manager [req-68d3d448-ac20-4492-90c6-0067a190395f req-97b3e196-d6ce-4e9e-b910-f28c52fe5766 tempest-ServerActionsTestJSON-1048786641 None] attachment_update completed successfully. Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8315093-aba5-4adf-8381-c59806b42282 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] volume v_c8315093-aba5-4adf-8381-c59806b42282 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.quota [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Created reservations ['a049f43c-6c09-4232-87a9-a40bc281ee9b', '0841b3ed-2f43-4732-b2c1-aa3db161a6aa', '8db2b2e2-9aab-447a-91a2-03deeeef7958', 'a75ece01-e996-41e9-b8fa-df1604813e0b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] create export for volume: 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] ensure volume 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] check if targe iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] create target and attach volume 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] create target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248642560', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.manager [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:20:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Deleted volume successfully. Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9fa1e3cf-772b-46eb-a34e-e196c24990e5 tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-c8315093-aba5-4adf-8381-c59806b42282-delete_volume" released by "delete_volume" :: held 4.454s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Acquiring lock "cinder-18016742-a15a-4e85-9fb9-4cbfd819316b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-18016742-a15a-4e85-9fb9-4cbfd819316b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] remove_export for volume: 18016742-a15a-4e85-9fb9-4cbfd819316b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1908156496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=18016742-a15a-4e85-9fb9-4cbfd819316b,launched_at=2023-04-14T04:17:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth='CHAP nQRoZmkl Yd7A8B1x5HbT6E',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:26Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:20:38Z,updated_at=2023-04-14T04:20:38Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume v_18016742-a15a-4e85-9fb9-4cbfd819316b from target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns/v_18016742-a15a-4e85-9fb9-4cbfd819316b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b/luns/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] failed to remove resource iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b because of JDSS resource v_18016742-a15a-4e85-9fb9-4cbfd819316b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] delete target: iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] delete target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] failed to remove resource iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b because of JDSS resource iqn.2010-10.org.openstack:18016742-a15a-4e85-9fb9-4cbfd819316b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] deleating volume v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] get snapshots for volume v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] get volume v_18016742-a15a-4e85-9fb9-4cbfd819316b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_18016742-a15a-4e85-9fb9-4cbfd819316b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447255', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114830', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12223443856886795348', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ad64548f162c4c25', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248642560', 'san:volume_id': 'ad64548f162c4c25e0bc202d7118424e2357623e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87844', 'name': 'v_18016742-a15a-4e85-9fb9-4cbfd819316b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] delete volume:v_18016742-a15a-4e85-9fb9-4cbfd819316b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] atach volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 to target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18016742-a15a-4e85-9fb9-4cbfd819316b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] volume v_18016742-a15a-4e85-9fb9-4cbfd819316b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.quota [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Created reservations ['1bba5655-9aee-4b93-881e-1b64e6a27d6e', 'b0cca282-a869-48e5-896b-c5c1a90ec621', '96d31280-5f20-46cb-a9c4-1f66da7e9f85', '494f0c5f-39d0-4f8d-9f88-a6c51e9adb74'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Acquiring lock "cinder-31382528-1966-4f19-8a4a-94983a6314c3-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-31382528-1966-4f19-8a4a-94983a6314c3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] remove_export for volume: 31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-224844915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=31382528-1966-4f19-8a4a-94983a6314c3,launched_at=2023-04-14T04:17:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225e61ca983d4f27adc61ad33c81fce4',provider_auth='CHAP ZFpuzxGw 4P9UZf5KuYplTQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:58Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:20:41Z,updated_at=2023-04-14T04:20:41Z,use_quota=True,user_id='b848680106b74275a947f316ce6311fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] detach volume v_31382528-1966-4f19-8a4a-94983a6314c3 from target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3/luns/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] failed to remove resource iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 because of JDSS resource v_31382528-1966-4f19-8a4a-94983a6314c3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] delete target: iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] delete target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] failed to remove resource iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 because of JDSS resource iqn.2010-10.org.openstack:31382528-1966-4f19-8a4a-94983a6314c3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] deleating volume v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] get snapshots for volume v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '16285696', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:40:52', 'volsize': '1073741824', 'createtxg': '114825', 'guid': '7067704034035925434', 'compressratio': '1.17', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '16285696', 'type': 'snapshot', 'secondarycache': 'all', 'used': '307200', 'refcompressratio': '1.17', 'fscontext': 'none', 'clones': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'objsetid': '87838', 'name': 'v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'defer_destroy': 'off', 'san:volume_id': '1221a0b31c6cf30334eb95aa004541d08a0a387f', 'mlslabel': 'none', 'logicalreferenced': '19042304', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248736768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.manager [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:20:41 user cinder-volume[73393]: INFO cinder.volume.manager [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Deleted volume successfully. Apr 14 04:20:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-03cb18c0-dc30-4298-957e-93177894b5ac tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-18016742-a15a-4e85-9fb9-4cbfd819316b-delete_volume" released by "delete_volume" :: held 4.163s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3166346461363135', 'lun': 0, 'mode': 'wt', 'name': 'v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'prod_id': 'Storage', 'scsi_id': '1f4da6155f843201'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] add credentails to target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 201, 'error': None, 'data': {'name': 'SvtMEfzm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] initialize_connection for 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvtMEfzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'f6c08d20-8171-4b4a-a116-07bc4dc24f0c'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:20:42 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=65,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:42 user cinder-volume[73393]: INFO cinder.volume.manager [req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb req-502af336-eae6-49ea-9068-cf3054081f20 tempest-ServerStableDeviceRescueTest-1018370864 None] attachment_update completed successfully. Apr 14 04:20:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_31382528-1966-4f19-8a4a-94983a6314c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] volume v_31382528-1966-4f19-8a4a-94983a6314c3 updated {{(pid=73393) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 04:20:43 user cinder-volume[73393]: DEBUG cinder.quota [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Created reservations ['a77915e3-979f-46f2-be09-a07fbebb6994', 'ea80536a-47e7-4286-a59a-ffb431d22618', 'd51fae0c-caf3-46bb-b926-ac6332c8ca6c', '5eae714a-3520-4086-82ae-075fdad62733'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=24,cinder:SELECT=67,cinder:DELETE=1,cinder:INSERT=8 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] terminate connection for 3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:20:44 user cinder-volume[73393]: INFO cinder.volume.manager [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Terminate volume connection completed successfully. Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Deleting attachment 4372af92-6441-4463-9a7f-3e4c116e5a00. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1183423330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3e0082ad-1ad0-4980-a066-6017f65fce9e,launched_at=2023-04-14T04:20:28Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP YjWqRKtu lfA29KzFXS4idg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:27Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:20:40Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] detach volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e from target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248736768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.manager [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:20:44 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Deleted volume successfully. Apr 14 04:20:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b4661145-11f6-4ad2-8716-ccbb83eb705b tempest-TaggedBootDevicesTest_v242-581315356 None] Lock "cinder-31382528-1966-4f19-8a4a-94983a6314c3-delete_volume" released by "delete_volume" :: held 3.866s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:20:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:20:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:20:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-7572447b-f1e5-4946-9bd1-c092e0706ec4 tempest-ServerActionsTestJSON-1048786641 None] target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] create export for volume: 3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] ensure volume 3e0082ad-1ad0-4980-a066-6017f65fce9e assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] check if targe iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] create target and attach volume 3e0082ad-1ad0-4980-a066-6017f65fce9e to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] create target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] atach volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e to target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:20:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3362346236663531', 'lun': 0, 'mode': 'wt', 'name': 'v_3e0082ad-1ad0-4980-a066-6017f65fce9e', 'prod_id': 'Storage', 'scsi_id': '3b4b6f51086736b8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] add credentails to target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:20:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YjWqRKtu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] initialize_connection for 3e0082ad-1ad0-4980-a066-6017f65fce9e 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:20:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjWqRKtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5257d9f6-4ed2-4452-88cf-1cd5a4131e1f'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:20:51 user cinder-volume[73393]: INFO cinder.volume.manager [req-8fa1968a-9ef4-4862-8abd-d310b36852da req-98723ed2-a8d6-4932-8da4-fc12e7d0a53e tempest-ServerActionsTestJSON-1048786641 None] attachment_update completed successfully. Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a787ba4f-021d-4423-ae5f-86a32d4a3e1d tempest-VolumesActionsTest-447148503 None] Acquiring lock "cinder-16203803-41c1-4da7-804c-d344751cb449" by "attach_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a787ba4f-021d-4423-ae5f-86a32d4a3e1d tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449" acquired by "attach_volume" :: waited 0.023s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:20:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a787ba4f-021d-4423-ae5f-86a32d4a3e1d tempest-VolumesActionsTest-447148503 None] Attaching volume 16203803-41c1-4da7-804c-d344751cb449 to instance 313835fa-6405-41ba-bc89-c4bfc119326a at mountpoint /dev/vdb on host None. Apr 14 04:20:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a787ba4f-021d-4423-ae5f-86a32d4a3e1d tempest-VolumesActionsTest-447148503 None] Attach volume completed successfully. Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a787ba4f-021d-4423-ae5f-86a32d4a3e1d tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449" released by "attach_volume" :: held 0.073s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Acquiring lock "cinder-16203803-41c1-4da7-804c-d344751cb449-detach_volume" by "detach_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:20:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Detaching volume 16203803-41c1-4da7-804c-d344751cb449 from instance 313835fa-6405-41ba-bc89-c4bfc119326a. Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] remove_export for volume: 16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355191391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=16203803-41c1-4da7-804c-d344751cb449,launched_at=2023-04-14T04:16:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280aa55745a749b7baa134334d25c9c3',provider_auth='CHAP wIRreYbm CcQBFaRTqU9NoM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:18Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:20:54Z,use_quota=True,user_id='6e422970cd8340bf996a135088094f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] detach volume v_16203803-41c1-4da7-804c-d344751cb449 from target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] failed to remove resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 because of JDSS resource v_16203803-41c1-4da7-804c-d344751cb449 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] delete target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] delete target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] failed to remove resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 because of JDSS resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:20:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Detach volume completed successfully. Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b28430e2-735d-4158-9cf0-8126e1c8364b tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Acquiring lock "cinder-80a9f7e6-e364-4c2b-9814-96061ad47dd6-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Lock "cinder-80a9f7e6-e364-4c2b-9814-96061ad47dd6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] remove_export for volume: 80a9f7e6-e364-4c2b-9814-96061ad47dd6. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1539333457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80a9f7e6-e364-4c2b-9814-96061ad47dd6,launched_at=2023-04-14T04:16:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cefa66350a4432ad71204b39e953be',provider_auth='CHAP NtrRMlgi lpjDPCEoQ3FGm4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:55Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:20:55Z,updated_at=2023-04-14T04:20:55Z,use_quota=True,user_id='0aeeeae7cbc340daa8cd81c1418794e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] detach volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 from target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6/luns/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] failed to remove resource iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 because of JDSS resource v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] delete target: iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] delete target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] failed to remove resource iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 because of JDSS resource iqn.2010-10.org.openstack:80a9f7e6-e364-4c2b-9814-96061ad47dd6 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] deleating volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] get snapshots for volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] get volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447224', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114788', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5147347640941582044', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4c6b6bec76a3edfa', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248736768', 'san:volume_id': '4c6b6bec76a3edfaadc9f9e953bce6cbd8407c60', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87706', 'name': 'v_80a9f7e6-e364-4c2b-9814-96061ad47dd6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] delete volume:v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] volume v_80a9f7e6-e364-4c2b-9814-96061ad47dd6 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:20:57 user cinder-volume[73393]: DEBUG cinder.quota [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Created reservations ['5ca90636-eb3f-4d13-a8a4-90dae77718ab', '82ecc17b-efdf-405c-ab4a-40a93f8f9747', 'ac216dd1-9f69-4c5f-acc7-07c302238275', 'ba2be9d0-7acf-472c-8b86-e82a696ee11b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248843264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.manager [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:20:58 user cinder-volume[73393]: INFO cinder.volume.manager [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Deleted volume successfully. Apr 14 04:20:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-977b9a6b-5f79-4783-9999-aa6b0afa0643 tempest-TaggedAttachmentsTest-926384577 None] Lock "cinder-80a9f7e6-e364-4c2b-9814-96061ad47dd6-delete_volume" released by "delete_volume" :: held 4.029s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Flow 'volume_create_manager' (b4593958-4c33-43be-a018-418150f6a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de41fe18-1b96-43be-bc0e-166fb4c353cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de41fe18-1b96-43be-bc0e-166fb4c353cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1604256241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb50bb9a-116c-45cb-8505-cb7f1dcd3350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7ecdba5764723a39576e72c258994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:12Z,use_quota=True,user_id='3dbbcd7755154be092376e01c7f17bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9887bb-1366-4ff6-a30e-c37652ac2d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9887bb-1366-4ff6-a30e-c37652ac2d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0342e681-2de4-43da-9e99-335e64fb88a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0342e681-2de4-43da-9e99-335e64fb88a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'volume_name': 'volume-eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa8af7-47d7-4ef7-9d3d-b86ad74bc963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa8af7-47d7-4ef7-9d3d-b86ad74bc963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97dce892-e5d9-41ca-8176-dc384eb4bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:12 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Volume eb50bb9a-116c-45cb-8505-cb7f1dcd3350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'volume_size': 1} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] creating volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] create volume {'name': 'v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'is_clone': False, 'name': 'v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:13 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=51,cinder:INSERT=4,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97dce892-e5d9-41ca-8176-dc384eb4bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272da9ce-da8e-4527-8770-453f551d165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Volume volume-eb50bb9a-116c-45cb-8505-cb7f1dcd3350 (eb50bb9a-116c-45cb-8505-cb7f1dcd3350): created successfully Apr 14 04:21:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272da9ce-da8e-4527-8770-453f551d165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Flow 'volume_create_manager' (b4593958-4c33-43be-a018-418150f6a223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7eb3a8ff-dd62-4fe1-b1a5-c39ccbae9c03 tempest-VolumesDeleteCascade-1317523499 None] Created volume successfully. Apr 14 04:21:14 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=14,cinder:SELECT=54,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] create snapshot 4c0144c3-83b7-4539-aced-f9ead69f5ba0 for volume eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:21:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] cloning v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 to s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] create snapshot s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_4c0144c3-83b7-4539-aced-f9ead69f5ba0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] create volume s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 from snapshot s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350@s_4c0144c3-83b7-4539-aced-f9ead69f5ba0', 'is_clone': True, 'full_name': 'Pool-0/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0', 'name': 's_4c0144c3-83b7-4539-aced-f9ead69f5ba0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] volume s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:21:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2e48a483-9e27-431e-87fd-4415a943dc28 tempest-VolumesDeleteCascade-1317523499 None] Create snapshot completed successfully Apr 14 04:21:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] create snapshot f356cddf-0668-4ef1-b669-a45e78b26938 for volume eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:21:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] cloning v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 to s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] create snapshot s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f356cddf-0668-4ef1-b669-a45e78b26938'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] create volume s_f356cddf-0668-4ef1-b669-a45e78b26938 from snapshot s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Acquiring lock "cinder-eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Lock "cinder-eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] remove_export for volume: eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-24781138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370,launched_at=2023-04-14T04:17:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffadee5eeb7f4b42ae93e2e2578ef897',provider_auth='CHAP GcuPjMLZ MgPp9wXI7yqnUY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:06Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:21:19Z,updated_at=2023-04-14T04:21:19Z,use_quota=True,user_id='1da030e7c9e44f9b82f3286378a2ede6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] detach volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 from target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/luns/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] failed to remove resource iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 because of JDSS resource v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] delete target: iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] delete target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] failed to remove resource iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 because of JDSS resource iqn.2010-10.org.openstack:eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] deleating volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] get snapshots for volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350@s_f356cddf-0668-4ef1-b669-a45e78b26938', 'is_clone': True, 'full_name': 'Pool-0/s_f356cddf-0668-4ef1-b669-a45e78b26938', 'name': 's_f356cddf-0668-4ef1-b669-a45e78b26938'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] volume s_f356cddf-0668-4ef1-b669-a45e78b26938 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] get volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:20 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6a56eb2e-290a-4d5f-aee8-659fdbb06ff8 tempest-VolumesDeleteCascade-1317523499 None] Create snapshot completed successfully Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447235', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114801', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17871477465396806449', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b854b0363086588c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238562304', 'san:volume_id': 'b854b0363086588c27211bd6cb36743110a82fae', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87820', 'name': 'v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] delete volume:v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Acquiring lock "cinder-eb50bb9a-116c-45cb-8505-cb7f1dcd3350-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-eb50bb9a-116c-45cb-8505-cb7f1dcd3350-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] remove_export for volume: eb50bb9a-116c-45cb-8505-cb7f1dcd3350. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1604256241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb50bb9a-116c-45cb-8505-cb7f1dcd3350,launched_at=2023-04-14T04:21:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7ecdba5764723a39576e72c258994',provider_auth='CHAP tCBVHfQU C30FUmOoS2GfzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:12Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:21:21Z,updated_at=2023-04-14T04:21:21Z,use_quota=True,user_id='3dbbcd7755154be092376e01c7f17bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] detach volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 from target iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350/luns/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350/luns/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350/luns/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350/luns/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] failed to remove resource iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 because of JDSS resource v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] delete target: iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] delete target iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] failed to remove resource iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 because of JDSS resource iqn.2010-10.org.openstack:eb50bb9a-116c-45cb-8505-cb7f1dcd3350 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Performing cascade delete. {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Acquiring lock "cinder-4c0144c3-83b7-4539-aced-f9ead69f5ba0-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-4c0144c3-83b7-4539-aced-f9ead69f5ba0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] deleating snapshot s_4c0144c3-83b7-4539-aced-f9ead69f5ba0. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] get volume s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350@s_4c0144c3-83b7-4539-aced-f9ead69f5ba0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447484', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115016', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8715873157094647953', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a92ff13cabd30144', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238644224', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88210', 'name': 's_4c0144c3-83b7-4539-aced-f9ead69f5ba0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] delete snapshot s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 of volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] volume v_eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.quota [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Created reservations ['f7420ceb-f571-4a95-b843-d362f54ef618', 'f67ce9d0-f1b5-480b-8746-a621d703954d', '8a1800af-3159-4325-b165-9465504f6bec', '36946529-1bf9-451a-9cd6-7abcc619ec16'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.coordination [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Acquiring lock "cinder-f3255f25-0334-46dd-a514-12a56a1deffd-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.coordination [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Lock "cinder-f3255f25-0334-46dd-a514-12a56a1deffd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] remove_export for volume: f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1291039934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f3255f25-0334-46dd-a514-12a56a1deffd,launched_at=2023-04-14T04:17:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffadee5eeb7f4b42ae93e2e2578ef897',provider_auth='CHAP PuAKITjr 51syx2hVFSmOTK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:17:03Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:21:23Z,updated_at=2023-04-14T04:21:23Z,use_quota=True,user_id='1da030e7c9e44f9b82f3286378a2ede6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] detach volume v_f3255f25-0334-46dd-a514-12a56a1deffd from target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd/luns/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] failed to remove resource iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd because of JDSS resource v_f3255f25-0334-46dd-a514-12a56a1deffd DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] delete target: iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] delete target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238631936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.manager [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:21:22 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Deleted volume successfully. Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] failed to remove resource iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd because of JDSS resource iqn.2010-10.org.openstack:f3255f25-0334-46dd-a514-12a56a1deffd DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] deleating volume v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] get snapshots for volume v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:22 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8c379c73-f566-411e-afb4-9d7b352713bc tempest-TestVolumeSwap-926061730 None] Lock "cinder-eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots/s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] snapshot s_4c0144c3-83b7-4539-aced-f9ead69f5ba0 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Created reservations ['c23dcbd6-cff4-4efb-a106-cb6c5f8513cd', '64d6cf5e-a500-4334-9bb0-e6ad2a7825bb', '171f3167-5830-4796-a3eb-f64aeee00713', '4b686ecc-d799-40c9-8941-663a9b2b2016'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:21:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Delete snapshot completed successfully. Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-4c0144c3-83b7-4539-aced-f9ead69f5ba0-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Acquiring lock "cinder-f356cddf-0668-4ef1-b669-a45e78b26938-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-f356cddf-0668-4ef1-b669-a45e78b26938-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] deleating snapshot s_f356cddf-0668-4ef1-b669-a45e78b26938. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] get volume v_f3255f25-0334-46dd-a514-12a56a1deffd info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f3255f25-0334-46dd-a514-12a56a1deffd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447232', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114796', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4288145380767227848', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3007e6d4cb2b44fb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238668800', 'san:volume_id': '3007e6d4cb2b44fbb06b2a852fc25f7893346c3c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87725', 'name': 'v_f3255f25-0334-46dd-a514-12a56a1deffd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] delete volume:v_f3255f25-0334-46dd-a514-12a56a1deffd recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] get volume s_f356cddf-0668-4ef1-b669-a45e78b26938 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350@s_f356cddf-0668-4ef1-b669-a45e78b26938', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f356cddf-0668-4ef1-b669-a45e78b26938', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447488', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115022', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10923803701070167289', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e2d093a8dda2f8e7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238668800', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88226', 'name': 's_f356cddf-0668-4ef1-b669-a45e78b26938', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] delete snapshot s_f356cddf-0668-4ef1-b669-a45e78b26938 of volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots/s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots/s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238738432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f3255f25-0334-46dd-a514-12a56a1deffd {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] volume v_f3255f25-0334-46dd-a514-12a56a1deffd deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.quota [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Created reservations ['bff43725-ed79-4d25-9758-65d35d4cb503', 'a942a674-3695-4d41-8059-354123e57023', '8afac3e9-edef-4230-b56f-34728d03fe1c', 'ad0a2de9-cd5f-471d-bd80-3d0fb93ca4d0'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots/s_f356cddf-0668-4ef1-b669-a45e78b26938 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] snapshot s_f356cddf-0668-4ef1-b669-a45e78b26938 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.quota [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Created reservations ['2d161138-09e5-4a20-bd1f-4f3afb8235ce', 'b372cb0a-32ca-40f8-a509-179609e8ee9e', 'e3f4eb92-8b87-41bd-ab9b-ae6374b9b590', '229a6f34-f7ca-4234-8d67-1a5f36b3890f'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:21:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Delete snapshot completed successfully. Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-f356cddf-0668-4ef1-b669-a45e78b26938-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Snapshots deleted, issuing volume delete {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] deleating volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238763008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.manager [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:21:26 user cinder-volume[73393]: INFO cinder.volume.manager [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Deleted volume successfully. Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.coordination [None req-78a6b13c-660e-4089-8ed2-623f98933de9 tempest-TestVolumeSwap-926061730 None] Lock "cinder-f3255f25-0334-46dd-a514-12a56a1deffd-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] get volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447481', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115010', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6127915030611471870', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd9fdd3d7e7b363d8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238763008', 'san:volume_id': 'd9fdd3d7e7b363d8e9f3cf646e44540bee68ba3f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88197', 'name': 'v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] delete volume:v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Flow 'volume_create_manager' (ec59d702-e5fd-4e36-8daf-0b1f743795e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371c9136-054b-4c14-bc0e-809101f449e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371c9136-054b-4c14-bc0e-809101f449e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1941384427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e56b46c4-52ea-450b-8863-68ccb4ade295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33320dc2f2c14ecfa5abf6574029c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:27Z,use_quota=True,user_id='5234914aec8e443b8a38ac6b38729031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0e264a-d0aa-47c0-ab2c-e45da98d7add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0e264a-d0aa-47c0-ab2c-e45da98d7add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5912c728-205f-4244-817c-fe388288bee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5912c728-205f-4244-817c-fe388288bee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56b46c4-52ea-450b-8863-68ccb4ade295', 'volume_name': 'volume-e56b46c4-52ea-450b-8863-68ccb4ade295', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d858d8-0344-4a37-aa1c-e6b113720667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d858d8-0344-4a37-aa1c-e6b113720667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e2f2a-0495-488e-bc38-49320960e232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:26 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Volume e56b46c4-52ea-450b-8863-68ccb4ade295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56b46c4-52ea-450b-8863-68ccb4ade295', 'volume_size': 1} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] creating volume v_e56b46c4-52ea-450b-8863-68ccb4ade295. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] create volume {'name': 'v_e56b46c4-52ea-450b-8863-68ccb4ade295', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=10 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e56b46c4-52ea-450b-8863-68ccb4ade295', 'is_clone': False, 'name': 'v_e56b46c4-52ea-450b-8863-68ccb4ade295'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e2f2a-0495-488e-bc38-49320960e232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56b46c4-52ea-450b-8863-68ccb4ade295', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83049bb-5f53-4ca4-bc5f-ffdb5fadc917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Volume volume-e56b46c4-52ea-450b-8863-68ccb4ade295 (e56b46c4-52ea-450b-8863-68ccb4ade295): created successfully Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83049bb-5f53-4ca4-bc5f-ffdb5fadc917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Flow 'volume_create_manager' (ec59d702-e5fd-4e36-8daf-0b1f743795e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fe35ec59-80a7-40ee-abfc-7c9413f2c4ad tempest-ServerRescueNegativeTestJSON-508041341 None] Created volume successfully. Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] volume v_eb50bb9a-116c-45cb-8505-cb7f1dcd3350 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.quota [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Created reservations ['2233cb2f-3172-4dbc-9c9b-85c0f954f24b', 'be8ebfc6-da4c-480a-951e-a99ee763f7fe', 'e72806a5-55d7-421a-81e1-323544600943', '8ad653ad-7808-4b28-b259-d67bb2ebb83d'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238750720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.manager [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:21:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Deleted volume successfully. Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2b7a1e50-b72d-471b-b5bf-aa7f9ec6f1ed tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-eb50bb9a-116c-45cb-8505-cb7f1dcd3350-delete_volume" released by "delete_volume" :: held 8.050s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Flow 'volume_create_manager' (a0c48205-3135-4c6a-9b4b-4fdde2568b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dfa018-9493-4ac4-b5b4-56abce44ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dfa018-9493-4ac4-b5b4-56abce44ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-166375806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c033fb68-e273-4b8e-8f99-b161635751a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7ecdba5764723a39576e72c258994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:29Z,use_quota=True,user_id='3dbbcd7755154be092376e01c7f17bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe8c4fa-d845-4149-9ab1-a3b10747a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe8c4fa-d845-4149-9ab1-a3b10747a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd1c420-fddb-4a04-9801-844e61dde06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd1c420-fddb-4a04-9801-844e61dde06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c033fb68-e273-4b8e-8f99-b161635751a7', 'volume_name': 'volume-c033fb68-e273-4b8e-8f99-b161635751a7', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8472b31-79b0-4447-bdba-b9e3085214d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8472b31-79b0-4447-bdba-b9e3085214d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63e5329-07ff-4f94-89c3-4f2266923263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:29 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Volume c033fb68-e273-4b8e-8f99-b161635751a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c033fb68-e273-4b8e-8f99-b161635751a7', 'volume_size': 1} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] creating volume v_c033fb68-e273-4b8e-8f99-b161635751a7. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] create volume {'name': 'v_c033fb68-e273-4b8e-8f99-b161635751a7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c033fb68-e273-4b8e-8f99-b161635751a7', 'is_clone': False, 'name': 'v_c033fb68-e273-4b8e-8f99-b161635751a7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63e5329-07ff-4f94-89c3-4f2266923263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c033fb68-e273-4b8e-8f99-b161635751a7', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5a68fb-845f-4880-aa41-47252f590b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:30 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Volume volume-c033fb68-e273-4b8e-8f99-b161635751a7 (c033fb68-e273-4b8e-8f99-b161635751a7): created successfully Apr 14 04:21:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5a68fb-845f-4880-aa41-47252f590b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Flow 'volume_create_manager' (a0c48205-3135-4c6a-9b4b-4fdde2568b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-01ee3bba-3694-4073-9fb1-b02860026816 tempest-VolumesDeleteCascade-1317523499 None] Created volume successfully. Apr 14 04:21:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] create snapshot 24da281f-3d6b-406a-bead-265b65f03dff for volume c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:21:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] cloning v_c033fb68-e273-4b8e-8f99-b161635751a7 to s_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] create snapshot s_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_24da281f-3d6b-406a-bead-265b65f03dff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] create volume s_24da281f-3d6b-406a-bead-265b65f03dff from snapshot s_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c033fb68-e273-4b8e-8f99-b161635751a7@s_24da281f-3d6b-406a-bead-265b65f03dff', 'is_clone': True, 'full_name': 'Pool-0/s_24da281f-3d6b-406a-bead-265b65f03dff', 'name': 's_24da281f-3d6b-406a-bead-265b65f03dff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] volume s_24da281f-3d6b-406a-bead-265b65f03dff properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:21:34 user cinder-volume[73393]: INFO cinder.volume.manager [None req-12569bc7-1c78-44b1-9fc3-85e5787c5f40 tempest-VolumesDeleteCascade-1317523499 None] Create snapshot completed successfully Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Flow 'volume_create_manager' (9cae0ff6-d8e6-4d30-9cc1-27cb87462d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca91151-1cb2-4366-90c2-ef57cab8bc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca91151-1cb2-4366-90c2-ef57cab8bc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-738192639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94632ee7-9da8-4532-8e06-d5d498e008d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7ecdba5764723a39576e72c258994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=24da281f-3d6b-406a-bead-265b65f03dff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:35Z,use_quota=True,user_id='3dbbcd7755154be092376e01c7f17bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5065ebf-dc70-4ded-80bb-3212d1d518ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5065ebf-dc70-4ded-80bb-3212d1d518ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372f2bae-c125-4ded-b8a5-5db163e3b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372f2bae-c125-4ded-b8a5-5db163e3b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94632ee7-9da8-4532-8e06-d5d498e008d9', 'volume_name': 'volume-94632ee7-9da8-4532-8e06-d5d498e008d9', 'volume_size': 1, 'snapshot_id': '24da281f-3d6b-406a-bead-265b65f03dff'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2702b1-ac23-4d57-b86a-27937924cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2702b1-ac23-4d57-b86a-27937924cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ee4b65-7199-43c9-b8ae-1c40151ecc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Volume 94632ee7-9da8-4532-8e06-d5d498e008d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94632ee7-9da8-4532-8e06-d5d498e008d9', 'volume_size': 1, 'snapshot_id': '24da281f-3d6b-406a-bead-265b65f03dff'} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] create volume 94632ee7-9da8-4532-8e06-d5d498e008d9 from snapshot 24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] cloning s_24da281f-3d6b-406a-bead-265b65f03dff to v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] create snapshot v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_94632ee7-9da8-4532-8e06-d5d498e008d9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] create volume v_94632ee7-9da8-4532-8e06-d5d498e008d9 from snapshot v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_24da281f-3d6b-406a-bead-265b65f03dff@v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'is_clone': True, 'full_name': 'Pool-0/v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'name': 'v_94632ee7-9da8-4532-8e06-d5d498e008d9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] get volume v_94632ee7-9da8-4532-8e06-d5d498e008d9 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_24da281f-3d6b-406a-bead-265b65f03dff@v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447505', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115053', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14596340272374023940', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3cc86b25e368d5cf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238631936', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87896', 'name': 'v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ee4b65-7199-43c9-b8ae-1c40151ecc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94632ee7-9da8-4532-8e06-d5d498e008d9', 'volume_size': 1, 'snapshot_id': '24da281f-3d6b-406a-bead-265b65f03dff'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9712c6b8-68ef-4dc3-8a61-9387e75ffed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:37 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Volume volume-94632ee7-9da8-4532-8e06-d5d498e008d9 (94632ee7-9da8-4532-8e06-d5d498e008d9): created successfully Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9712c6b8-68ef-4dc3-8a61-9387e75ffed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Flow 'volume_create_manager' (9cae0ff6-d8e6-4d30-9cc1-27cb87462d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6f4df506-377f-4ef2-85d9-07f52680de76 tempest-VolumesDeleteCascade-1317523499 None] Created volume successfully. Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Acquiring lock "cinder-c033fb68-e273-4b8e-8f99-b161635751a7-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-c033fb68-e273-4b8e-8f99-b161635751a7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] remove_export for volume: c033fb68-e273-4b8e-8f99-b161635751a7. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-166375806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c033fb68-e273-4b8e-8f99-b161635751a7,launched_at=2023-04-14T04:21:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7ecdba5764723a39576e72c258994',provider_auth='CHAP ilsOTuKa TZvVin8lg2WmoL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:29Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:21:39Z,updated_at=2023-04-14T04:21:39Z,use_quota=True,user_id='3dbbcd7755154be092376e01c7f17bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] detach volume v_c033fb68-e273-4b8e-8f99-b161635751a7 from target iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7/luns/v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7/luns/v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7/luns/v_c033fb68-e273-4b8e-8f99-b161635751a7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7/luns/v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] failed to remove resource iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 because of JDSS resource v_c033fb68-e273-4b8e-8f99-b161635751a7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] delete target: iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] delete target iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] failed to remove resource iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 because of JDSS resource iqn.2010-10.org.openstack:c033fb68-e273-4b8e-8f99-b161635751a7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Performing cascade delete. {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Acquiring lock "cinder-24da281f-3d6b-406a-bead-265b65f03dff-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-24da281f-3d6b-406a-bead-265b65f03dff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] deleating snapshot s_24da281f-3d6b-406a-bead-265b65f03dff. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume s_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:45:05', 'volsize': '1073741824', 'createtxg': '115052', 'guid': '5680290026560479818', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'objsetid': '87979', 'name': 'v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] volume s_24da281f-3d6b-406a-bead-265b65f03dff updated {{(pid=73393) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.quota [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Created reservations ['c36105af-c84b-47a8-b2d8-54d6f7af4627', 'c1e7f8b3-bf16-40b3-91b7-c86cb0c0fa58', 'be6812b3-a9ad-4446-8035-b84897875a45', '6557a508-dc15-48ef-a82a-ed0e5255951f'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:21:40 user cinder-volume[73393]: INFO cinder.volume.manager [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Delete snapshot completed successfully. Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-24da281f-3d6b-406a-bead-265b65f03dff-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Snapshots deleted, issuing volume delete {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] deleating volume v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:45:01', 'volsize': '1073741824', 'createtxg': '115046', 'guid': '6197156878188114922', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_24da281f-3d6b-406a-bead-265b65f03dff', 'objsetid': '88073', 'name': 's_24da281f-3d6b-406a-bead-265b65f03dff', 'defer_destroy': 'off', 'san:volume_id': '13afd21e58e3c568df5efab47e9af8d50efe352a', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] volume v_c033fb68-e273-4b8e-8f99-b161635751a7 updated {{(pid=73393) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 04:21:43 user cinder-volume[73393]: DEBUG cinder.quota [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Created reservations ['980c5ea5-d31d-412f-a6bc-70d033606128', 'b18a9175-af71-46da-afa9-d3b0193d62d8', '3be76721-85a1-4c94-8586-ba0837f807d1', '83013ebb-b80e-4f9e-8ae4-97de08e9921b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:21:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:21:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:21:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238595072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.manager [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:21:44 user cinder-volume[73393]: INFO cinder.volume.manager [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Deleted volume successfully. Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-874d57c2-c805-4abf-9fdd-c3f097caca3c tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-c033fb68-e273-4b8e-8f99-b161635751a7-delete_volume" released by "delete_volume" :: held 5.686s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Acquiring lock "cinder-94632ee7-9da8-4532-8e06-d5d498e008d9-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-94632ee7-9da8-4532-8e06-d5d498e008d9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] remove_export for volume: 94632ee7-9da8-4532-8e06-d5d498e008d9. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-738192639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94632ee7-9da8-4532-8e06-d5d498e008d9,launched_at=2023-04-14T04:21:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7ecdba5764723a39576e72c258994',provider_auth='CHAP LTZtNRPO mvDfnrCP16BTex',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:35Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=24da281f-3d6b-406a-bead-265b65f03dff,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:21:44Z,updated_at=2023-04-14T04:21:44Z,use_quota=True,user_id='3dbbcd7755154be092376e01c7f17bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] detach volume v_94632ee7-9da8-4532-8e06-d5d498e008d9 from target iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9/luns/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9/luns/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9/luns/v_94632ee7-9da8-4532-8e06-d5d498e008d9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9/luns/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] failed to remove resource iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 because of JDSS resource v_94632ee7-9da8-4532-8e06-d5d498e008d9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] delete target: iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] delete target iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] failed to remove resource iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 because of JDSS resource iqn.2010-10.org.openstack:94632ee7-9da8-4532-8e06-d5d498e008d9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] deleating volume v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] get volume v_94632ee7-9da8-4532-8e06-d5d498e008d9 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_24da281f-3d6b-406a-bead-265b65f03dff@v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447505', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115053', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14596340272374023940', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3cc86b25e368d5cf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238595072', 'san:volume_id': '3cc86b25e368d5cffa4806c97cfb476f0ac469cd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87896', 'name': 'v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94632ee7-9da8-4532-8e06-d5d498e008d9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume t_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Flow 'volume_create_manager' (963ba64a-ae08-4753-9f52-9e0e552bb7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36de1d2e-d07d-4a73-ae74-88790f837a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36de1d2e-d07d-4a73-ae74-88790f837a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1148934730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f68baca6-c7bf-4426-9981-6b854e129b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0115fddb9d443ea0f3ba6000da2fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:45Z,use_quota=True,user_id='e1bed0ff9a514f3bb4eac8c8d2d614fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791b28ce-b627-4ce7-ab29-50fda11a4fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791b28ce-b627-4ce7-ab29-50fda11a4fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89728084-5974-4fed-abf5-5d3272b54759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89728084-5974-4fed-abf5-5d3272b54759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68baca6-c7bf-4426-9981-6b854e129b7b', 'volume_name': 'volume-f68baca6-c7bf-4426-9981-6b854e129b7b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24dbb68-1afe-4496-a574-557a8939cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24dbb68-1afe-4496-a574-557a8939cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08222fc6-7de1-4ded-84c9-389baed66105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:45 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Volume f68baca6-c7bf-4426-9981-6b854e129b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68baca6-c7bf-4426-9981-6b854e129b7b', 'volume_size': 1} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] creating volume v_f68baca6-c7bf-4426-9981-6b854e129b7b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] create volume {'name': 'v_f68baca6-c7bf-4426-9981-6b854e129b7b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:45:05', 'volsize': '1073741824', 'createtxg': '115052', 'guid': '5680290026560479818', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'objsetid': '87979', 'name': 'v_94632ee7-9da8-4532-8e06-d5d498e008d9', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_24da281f-3d6b-406a-bead-265b65f03dff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] get volume t_24da281f-3d6b-406a-bead-265b65f03dff info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_c033fb68-e273-4b8e-8f99-b161635751a7@s_24da281f-3d6b-406a-bead-265b65f03dff', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_24da281f-3d6b-406a-bead-265b65f03dff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447501', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115047', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16116039474746776329', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e03f10f89d2a505c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238595072', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88079', 'name': 't_24da281f-3d6b-406a-bead-265b65f03dff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_24da281f-3d6b-406a-bead-265b65f03dff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] get snapshots for volume t_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:45:01', 'volsize': '1073741824', 'createtxg': '115046', 'guid': '6197156878188114922', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_24da281f-3d6b-406a-bead-265b65f03dff', 'objsetid': '88073', 'name': 's_24da281f-3d6b-406a-bead-265b65f03dff', 'defer_destroy': 'off', 'san:volume_id': '13afd21e58e3c568df5efab47e9af8d50efe352a', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] get volume t_c033fb68-e273-4b8e-8f99-b161635751a7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_c033fb68-e273-4b8e-8f99-b161635751a7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447498', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115041', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11957710108297390807', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '13afd21e58e3c568', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238513152', 'san:volume_id': '13afd21e58e3c568df5efab47e9af8d50efe352a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87886', 'name': 't_c033fb68-e273-4b8e-8f99-b161635751a7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] delete volume:t_c033fb68-e273-4b8e-8f99-b161635751a7 recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b', 'is_clone': False, 'name': 'v_f68baca6-c7bf-4426-9981-6b854e129b7b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08222fc6-7de1-4ded-84c9-389baed66105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68baca6-c7bf-4426-9981-6b854e129b7b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0898c93-2eed-49fc-8d2d-e05a5833f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:46 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Volume volume-f68baca6-c7bf-4426-9981-6b854e129b7b (f68baca6-c7bf-4426-9981-6b854e129b7b): created successfully Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0898c93-2eed-49fc-8d2d-e05a5833f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Flow 'volume_create_manager' (963ba64a-ae08-4753-9f52-9e0e552bb7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-de24816a-8cab-4a4e-9afb-4da8ffffd7a4 tempest-SnapshotsActionsTest-2095277883 None] Created volume successfully. Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] copy_volume_to_image volume-16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) copy_volume_to_image /opt/stack/cinder/cinder/volume/driver.py:930}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG os_brick.utils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd5c0b4-ccd0-4eaf-a6b9-29d4052162a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66f2ad7cf0e5\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[73769dde-ae63-46f1-bda5-f55cb014fc94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d9cbde-cf43-4ff0-aee3-2a5aea4d1d3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c033fb68-e273-4b8e-8f99-b161635751a7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a92412-7662-4226-ba5a-52c3f15582d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Running cmd (subprocess): nvme version {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] 'nvme version' failed. Not Retrying. {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] nvme not present on system {{(pid=73393) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 04:21:47 user cinder-volume[73393]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 04:21:47 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ead2a-34eb-4a20-b345-bb362c5e59da]: (4, '') {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73393) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73393) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] LIGHTOS: no hostnqn found. {{(pid=73393) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG os_brick.utils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66f2ad7cf0e5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Volume 16203803-41c1-4da7-804c-d344751cb449: creating export {{(pid=73393) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] create export for volume: 16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] ensure volume 16203803-41c1-4da7-804c-d344751cb449 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] check if targe iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Lock "cinder-94632ee7-9da8-4532-8e06-d5d498e008d9-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server [None req-a70c3482-3aed-4783-8460-3c711881a402 tempest-VolumesDeleteCascade-1317523499 None] Exception during message handling: KeyError: 'errno' Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 369, in _delete_back_recursively Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self._delete_back_recursively( Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 04:21:47 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] create target and attach volume 16203803-41c1-4da7-804c-d344751cb449 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] create target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=28,cinder:SELECT=60,cinder:INSERT=8,cinder:DELETE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] create snapshot 8db4069a-efaf-4c46-88f4-62ec575a5872 for volume f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] cloning v_f68baca6-c7bf-4426-9981-6b854e129b7b to s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] create snapshot s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_8db4069a-efaf-4c46-88f4-62ec575a5872'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] create volume s_8db4069a-efaf-4c46-88f4-62ec575a5872 from snapshot s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_8db4069a-efaf-4c46-88f4-62ec575a5872', 'is_clone': True, 'full_name': 'Pool-0/s_8db4069a-efaf-4c46-88f4-62ec575a5872', 'name': 's_8db4069a-efaf-4c46-88f4-62ec575a5872'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] volume s_8db4069a-efaf-4c46-88f4-62ec575a5872 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:21:49 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e095c48a-6e82-48d2-a7ed-ba71542a2743 tempest-SnapshotsActionsTest-2095277883 None] Create snapshot completed successfully Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (712a28b2-1cc1-481d-9a5a-18e42fa15804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4af6222-9e14-4a87-be8a-2df8a584ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] atach volume v_16203803-41c1-4da7-804c-d344751cb449 to target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4af6222-9e14-4a87-be8a-2df8a584ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1139540466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=680b7f39-b5c0-4b97-8129-011d7477e610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:50Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e2206e-87f9-400e-bba0-02de64729b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e2206e-87f9-400e-bba0-02de64729b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b86e890-e860-4c36-a9cf-0ec6c0dcb217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b86e890-e860-4c36-a9cf-0ec6c0dcb217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '680b7f39-b5c0-4b97-8129-011d7477e610', 'volume_name': 'volume-680b7f39-b5c0-4b97-8129-011d7477e610', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ecb819-2b10-44a8-9f86-ab93c5da7b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ecb819-2b10-44a8-9f86-ab93c5da7b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b030185-800f-4560-ad6d-c66b75d6b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:50 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Volume 680b7f39-b5c0-4b97-8129-011d7477e610: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-680b7f39-b5c0-4b97-8129-011d7477e610', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Cloning 680b7f39-b5c0-4b97-8129-011d7477e610 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 21, 50, 349754)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 21, 50, 363818)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] create snapshot v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] create snapshot 377e4786-089e-4fdd-9dd2-5e30cab29f7b for volume f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] cloning v_f68baca6-c7bf-4426-9981-6b854e129b7b to s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] create snapshot s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3131353939373437', 'lun': 0, 'mode': 'wt', 'name': 'v_16203803-41c1-4da7-804c-d344751cb449', 'prod_id': 'Storage', 'scsi_id': '11599747eb90e35b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] add credentails to target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_680b7f39-b5c0-4b97-8129-011d7477e610'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] create volume v_680b7f39-b5c0-4b97-8129-011d7477e610 from snapshot v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Geting {'code': 201, 'error': None, 'data': {'name': 'wIRreYbm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] initialize_connection for 16203803-41c1-4da7-804c-d344751cb449 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connector [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Factory for iscsi on None {{(pid=73393) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIRreYbm', 'auth_password': '***', 'target_lun': False}}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:21:51 user cinder-volume[73393]: INFO os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fcd6a1-905c-44d3-a4f6-6b8714c41c0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 04:21:51 user cinder-volume[73393]: {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --interface default --op new {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f3cc2-a528-4ae8-a39d-114eb4e1a8cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449] added\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449] added Apr 14 04:21:51 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ef7f67-2195-412b-ae0d-6c04ec1292ca]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8a9d3c-dd14-449c-8924-5e2074115bea]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIRreYbm {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIRreYbm" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[b560d5e1-d83f-46d2-b843-e485e10937a7]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wIRreYbm'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[91178dc3-789d-4e89-9411-0883e1964ec7]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[2305f484-8026-4dd6-bfe8-9f8cd0ebb3c8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash) Apr 14 04:21:51 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --login {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:51 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e4bf21-0987-44fc-ab22-58f9eb26cd87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260] Apr 14 04:21:52 user cinder-volume[73393]: Login to [iface: default, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260] successful. Apr 14 04:21:52 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83581a5-2d59-4c66-8d7b-5bc05a54be1e]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[108090bb-13ef-4572-914a-f656ab869509]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 (non-flash) Apr 14 04:21:52 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Connected to 172.16.0.220:3260 {{(pid=73393) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] HCTL ('40', '-', '-', 0) found on session 21 with lun 0 {{(pid=73393) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Scanning host 40 c: -, t: -, l: 0) {{(pid=73393) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c870c1-36ff-4b79-8e3b-1e0bd8faf388]: (4, ('- - 0', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Searching for a device in session 21 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73393) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIRreYbm', 'auth_password': '***', 'target_lun': False} {{(pid=73393) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_377e4786-089e-4fdd-9dd2-5e30cab29f7b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] create volume s_377e4786-089e-4fdd-9dd2-5e30cab29f7b from snapshot s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23131353939373437', 'path': '/dev/sdi'} {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdi of=/dev/null count=1 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdi of=/dev/null count=1" returned: 0 in 0.017s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a6692d-4ea2-42d8-8631-43e9dcd9bd8b]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00204507 s, 250 kB/s\n')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] c42cbcb0-cfa7-4329-88ce-aae460a99303 was raw, no need to convert to raw {{(pid=73393) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1004}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdi {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:21:53 user sudo[87883]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdi Apr 14 04:21:53 user sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:21:53 user sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 14 04:21:53 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdi" returned: 0 in 0.693s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_680b7f39-b5c0-4b97-8129-011d7477e610', 'is_clone': True, 'full_name': 'Pool-0/v_680b7f39-b5c0-4b97-8129-011d7477e610', 'name': 'v_680b7f39-b5c0-4b97-8129-011d7477e610'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] get volume v_680b7f39-b5c0-4b97-8129-011d7477e610 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_377e4786-089e-4fdd-9dd2-5e30cab29f7b', 'is_clone': True, 'full_name': 'Pool-0/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b', 'name': 's_377e4786-089e-4fdd-9dd2-5e30cab29f7b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_680b7f39-b5c0-4b97-8129-011d7477e610', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_680b7f39-b5c0-4b97-8129-011d7477e610', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447521', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115078', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18063246716164828249', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4d4390b55b3126ad', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238451712', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87985', 'name': 'v_680b7f39-b5c0-4b97-8129-011d7477e610', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Marking volume 680b7f39-b5c0-4b97-8129-011d7477e610 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 680b7f39-b5c0-4b97-8129-011d7477e610. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Creating volume glance metadata for volume 680b7f39-b5c0-4b97-8129-011d7477e610 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] volume s_377e4786-089e-4fdd-9dd2-5e30cab29f7b properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:21:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5ab146fa-4f8d-458b-9530-d3e8e87dde3c tempest-SnapshotsActionsTest-2095277883 None] Create snapshot completed successfully Apr 14 04:21:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b030185-800f-4560-ad6d-c66b75d6b022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680b7f39-b5c0-4b97-8129-011d7477e610', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35a24f0-858c-423c-84ea-bc4af9932f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Volume volume-680b7f39-b5c0-4b97-8129-011d7477e610 (680b7f39-b5c0-4b97-8129-011d7477e610): created successfully Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35a24f0-858c-423c-84ea-bc4af9932f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (712a28b2-1cc1-481d-9a5a-18e42fa15804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4221cd8f-1919-4ea2-8d7c-ce9f5b8eb221 tempest-VolumesCloneTest-1249171373 None] Created volume successfully. Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Acquiring lock "cinder-377e4786-089e-4fdd-9dd2-5e30cab29f7b-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-377e4786-089e-4fdd-9dd2-5e30cab29f7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] deleating snapshot s_377e4786-089e-4fdd-9dd2-5e30cab29f7b. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] get snapshots for volume s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (96b12f50-ec05-43cd-93bc-5765de096c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a8d936-8827-4fd6-b5c6-7ae28898bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a8d936-8827-4fd6-b5c6-7ae28898bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-493130175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9751215-9103-40e4-a636-9ae68e2f215f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=680b7f39-b5c0-4b97-8129-011d7477e610,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:56Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c793711-8b87-4daf-9340-63bd2395bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c793711-8b87-4daf-9340-63bd2395bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f851bfc3-5799-4385-9c2d-1a0b5caf6922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f851bfc3-5799-4385-9c2d-1a0b5caf6922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b9751215-9103-40e4-a636-9ae68e2f215f', 'volume_name': 'volume-b9751215-9103-40e4-a636-9ae68e2f215f', 'volume_size': 1, 'source_volid': '680b7f39-b5c0-4b97-8129-011d7477e610', 'source_volstatus': 'available'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050c5be8-5fe7-4a2f-8c57-a9419242c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050c5be8-5fe7-4a2f-8c57-a9419242c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596542c6-9184-4d4b-85ff-fba98b587718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Volume b9751215-9103-40e4-a636-9ae68e2f215f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b9751215-9103-40e4-a636-9ae68e2f215f', 'volume_size': 1, 'source_volid': '680b7f39-b5c0-4b97-8129-011d7477e610', 'source_volstatus': 'available'} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] cloned volume 680b7f39-b5c0-4b97-8129-011d7477e610 to b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] cloning v_680b7f39-b5c0-4b97-8129-011d7477e610 to v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] create snapshot v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] get volume s_377e4786-089e-4fdd-9dd2-5e30cab29f7b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_b9751215-9103-40e4-a636-9ae68e2f215f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] create volume v_b9751215-9103-40e4-a636-9ae68e2f215f from snapshot v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_377e4786-089e-4fdd-9dd2-5e30cab29f7b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447522', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115081', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12337738955230242476', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '564150994ccbe602', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238464000', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87250', 'name': 's_377e4786-089e-4fdd-9dd2-5e30cab29f7b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] delete snapshot s_377e4786-089e-4fdd-9dd2-5e30cab29f7b of volume v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Flow 'volume_create_manager' (89f14e14-96c5-4a36-8d06-0f525eb1c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a583f4d4-76e1-4533-b2e8-6fdf543b7774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a583f4d4-76e1-4533-b2e8-6fdf543b7774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819489892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae0fb4af555422a847620627dffeae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:21:58Z,use_quota=True,user_id='ea68fb139b004f748cf1bcfb8d675a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968439d1-52bc-466b-a0cc-d62f015f05d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968439d1-52bc-466b-a0cc-d62f015f05d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f985fa76-f935-41f5-beda-732e55e5adf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f985fa76-f935-41f5-beda-732e55e5adf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'volume_name': 'volume-0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83c4e15-d43f-4af0-8f87-34b30d6049de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83c4e15-d43f-4af0-8f87-34b30d6049de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4122d500-6628-444d-9c39-20e0b865b464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:58 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Volume 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'volume_size': 1} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] creating volume v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] create volume {'name': 'v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_680b7f39-b5c0-4b97-8129-011d7477e610@v_b9751215-9103-40e4-a636-9ae68e2f215f', 'is_clone': True, 'full_name': 'Pool-0/v_b9751215-9103-40e4-a636-9ae68e2f215f', 'name': 'v_b9751215-9103-40e4-a636-9ae68e2f215f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] get volume v_b9751215-9103-40e4-a636-9ae68e2f215f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:21:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:21:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'is_clone': False, 'name': 'v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:21:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4122d500-6628-444d-9c39-20e0b865b464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f436ea4e-74d8-491e-bff8-26de00f29def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:21:59 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Volume volume-0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec (0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec): created successfully Apr 14 04:21:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f436ea4e-74d8-491e-bff8-26de00f29def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:21:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Flow 'volume_create_manager' (89f14e14-96c5-4a36-8d06-0f525eb1c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:21:59 user cinder-volume[73393]: INFO cinder.volume.manager [None req-01d469b3-4620-4021-8751-9010d1b225f1 tempest-ServersNegativeTestJSON-406789078 None] Created volume successfully. Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_377e4786-089e-4fdd-9dd2-5e30cab29f7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] snapshot s_377e4786-089e-4fdd-9dd2-5e30cab29f7b deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_680b7f39-b5c0-4b97-8129-011d7477e610@v_b9751215-9103-40e4-a636-9ae68e2f215f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9751215-9103-40e4-a636-9ae68e2f215f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447526', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115089', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13681084224720038697', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '713320e8dad50056', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238382080', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88093', 'name': 'v_b9751215-9103-40e4-a636-9ae68e2f215f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Marking volume b9751215-9103-40e4-a636-9ae68e2f215f as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.quota [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Created reservations ['e3a9d530-5f27-4bf5-90e3-318e57e98c48', '85a272d5-625d-426b-b013-f451ac9a029a', '22bdd47b-ef93-4e93-bd54-23c9b1d1294c', '761de5d2-20e0-48cc-bec4-5c30a7fa92ce'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Copying metadata from source volume 680b7f39-b5c0-4b97-8129-011d7477e610 to b9751215-9103-40e4-a636-9ae68e2f215f. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596542c6-9184-4d4b-85ff-fba98b587718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9751215-9103-40e4-a636-9ae68e2f215f', 'volume_size': 1, 'source_volid': '680b7f39-b5c0-4b97-8129-011d7477e610', 'source_volstatus': 'available'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116384c9-e807-4609-88ae-2f39a73f9e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:00 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Volume volume-b9751215-9103-40e4-a636-9ae68e2f215f (b9751215-9103-40e4-a636-9ae68e2f215f): created successfully Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116384c9-e807-4609-88ae-2f39a73f9e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (96b12f50-ec05-43cd-93bc-5765de096c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-887379c3-7339-4ad0-a7e5-688d5412cc60 tempest-VolumesCloneTest-1249171373 None] Created volume successfully. Apr 14 04:22:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Delete snapshot completed successfully. Apr 14 04:22:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3aa077e5-1711-48b7-a3dd-08029f6f9437 tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-377e4786-089e-4fdd-9dd2-5e30cab29f7b-delete_snapshot" released by "delete_snapshot" :: held 5.062s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Acquiring lock "cinder-b9751215-9103-40e4-a636-9ae68e2f215f-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Lock "cinder-b9751215-9103-40e4-a636-9ae68e2f215f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=56,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=23 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] create snapshot 331b5952-c072-4170-a227-884f202a2e41 for volume f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] cloning v_f68baca6-c7bf-4426-9981-6b854e129b7b to s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] create snapshot s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] remove_export for volume: b9751215-9103-40e4-a636-9ae68e2f215f. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-493130175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9751215-9103-40e4-a636-9ae68e2f215f,launched_at=2023-04-14T04:22:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth='CHAP adSGWTZQ GsYcqp0rM9D2wP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:56Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=680b7f39-b5c0-4b97-8129-011d7477e610,status='deleting',terminated_at=2023-04-14T04:22:01Z,updated_at=2023-04-14T04:22:01Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] detach volume v_b9751215-9103-40e4-a636-9ae68e2f215f from target iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f/luns/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f/luns/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_331b5952-c072-4170-a227-884f202a2e41'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] create volume s_331b5952-c072-4170-a227-884f202a2e41 from snapshot s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f/luns/v_b9751215-9103-40e4-a636-9ae68e2f215f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f/luns/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f because of JDSS resource v_b9751215-9103-40e4-a636-9ae68e2f215f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] delete target: iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] delete target iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_331b5952-c072-4170-a227-884f202a2e41', 'is_clone': True, 'full_name': 'Pool-0/s_331b5952-c072-4170-a227-884f202a2e41', 'name': 's_331b5952-c072-4170-a227-884f202a2e41'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f because of JDSS resource iqn.2010-10.org.openstack:b9751215-9103-40e4-a636-9ae68e2f215f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] deleating volume v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] get snapshots for volume v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] volume s_331b5952-c072-4170-a227-884f202a2e41 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:22:03 user cinder-volume[73393]: INFO cinder.volume.manager [None req-51802a3d-3336-43fe-9112-89fba324cb27 tempest-SnapshotsActionsTest-2095277883 None] Create snapshot completed successfully Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] terminate connection for 70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:22:04 user cinder-volume[73393]: INFO cinder.volume.manager [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Terminate volume connection completed successfully. Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Deleting attachment ff3d8abd-b66f-43ca-baed-8c5b606bd22b. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] remove_export for volume: 70317b0d-2515-45ac-825b-207626822497. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1673433759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=70317b0d-2515-45ac-825b-207626822497,launched_at=2023-04-14T04:19:47Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0a60f60717b44f4ba904a949eabfe608',provider_auth='CHAP HkOfdlri ND2Pn4oiHQ5wIj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:46Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:22:02Z,use_quota=True,user_id='982f167333954612a51911fc8d6c1ce9',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] detach volume v_70317b0d-2515-45ac-825b-207626822497 from target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] get volume v_b9751215-9103-40e4-a636-9ae68e2f215f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Acquiring lock "cinder-331b5952-c072-4170-a227-884f202a2e41-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] delete target: iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] delete target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-331b5952-c072-4170-a227-884f202a2e41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] deleating snapshot s_331b5952-c072-4170-a227-884f202a2e41. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] get snapshots for volume s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_680b7f39-b5c0-4b97-8129-011d7477e610@v_b9751215-9103-40e4-a636-9ae68e2f215f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9751215-9103-40e4-a636-9ae68e2f215f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447526', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115089', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13681084224720038697', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '713320e8dad50056', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238308352', 'san:volume_id': '713320e8dad50056f392ddd5f60a6385326e71f5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88093', 'name': 'v_b9751215-9103-40e4-a636-9ae68e2f215f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] delete snapshot v_b9751215-9103-40e4-a636-9ae68e2f215f of volume v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-acc239df-616b-4636-a442-daf1ab9f7363 req-8c058dd0-0219-4cfe-8506-4e315917d0af tempest-TestMinimumBasicScenario-1872250892 None] target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] get volume s_331b5952-c072-4170-a227-884f202a2e41 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_331b5952-c072-4170-a227-884f202a2e41', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_331b5952-c072-4170-a227-884f202a2e41', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447531', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115101', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16148238623824932207', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a4abf37f727c212c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238308352', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88112', 'name': 's_331b5952-c072-4170-a227-884f202a2e41', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] delete snapshot s_331b5952-c072-4170-a227-884f202a2e41 of volume v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots/v_b9751215-9103-40e4-a636-9ae68e2f215f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] snapshot v_b9751215-9103-40e4-a636-9ae68e2f215f deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.quota [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Created reservations ['264fcd67-7a6d-4dcb-b43e-e8af054d0a38', '0fd94714-bce2-457d-81f6-daf8474db472', '827c8052-fb2c-4c4f-ac25-53f3ecc080b5', '99feafe5-0f8e-4d2e-b8a2-c796cf00556f'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_331b5952-c072-4170-a227-884f202a2e41 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] snapshot s_331b5952-c072-4170-a227-884f202a2e41 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=67,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.quota [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Created reservations ['a256ddf2-4b8a-4e2b-ad27-b4a657c31cdc', '80fdc900-4220-4547-92c7-f3285f1584df', 'ad68ec45-9701-4ded-bea4-cdc6f361a637', '4fab8349-dd61-43dc-84dc-ee6e4bf32da2'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Delete snapshot completed successfully. Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1de9e18a-efb4-4656-a28b-800d002e84f8 tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-331b5952-c072-4170-a227-884f202a2e41-delete_snapshot" released by "delete_snapshot" :: held 2.627s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238345216', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.manager [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Deleted volume successfully. Apr 14 04:22:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3c8aa422-b88a-4015-b8e7-a1b18022567d tempest-VolumesCloneTest-1249171373 None] Lock "cinder-b9751215-9103-40e4-a636-9ae68e2f215f-delete_volume" released by "delete_volume" :: held 6.481s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Acquiring lock "cinder-680b7f39-b5c0-4b97-8129-011d7477e610-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Lock "cinder-680b7f39-b5c0-4b97-8129-011d7477e610-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] remove_export for volume: 680b7f39-b5c0-4b97-8129-011d7477e610. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1139540466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=680b7f39-b5c0-4b97-8129-011d7477e610,launched_at=2023-04-14T04:21:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth='CHAP vmufhdMk 13DLHijITPgQVO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:50Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:08Z,updated_at=2023-04-14T04:22:08Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] detach volume v_680b7f39-b5c0-4b97-8129-011d7477e610 from target iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610/luns/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610/luns/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610/luns/v_680b7f39-b5c0-4b97-8129-011d7477e610'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610/luns/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 because of JDSS resource v_680b7f39-b5c0-4b97-8129-011d7477e610 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] delete target: iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] delete target iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 because of JDSS resource iqn.2010-10.org.openstack:680b7f39-b5c0-4b97-8129-011d7477e610 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] deleating volume v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] get snapshots for volume v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] create snapshot ca828ba4-8a47-472f-88f9-32109225514e for volume f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] cloning v_f68baca6-c7bf-4426-9981-6b854e129b7b to s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] create snapshot s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] get volume v_680b7f39-b5c0-4b97-8129-011d7477e610 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_680b7f39-b5c0-4b97-8129-011d7477e610', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_680b7f39-b5c0-4b97-8129-011d7477e610', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447521', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115078', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18063246716164828249', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4d4390b55b3126ad', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238345216', 'san:volume_id': '4d4390b55b3126ad35a7b0bd540f17b6d1dd6111', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87985', 'name': 'v_680b7f39-b5c0-4b97-8129-011d7477e610', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] delete snapshot v_680b7f39-b5c0-4b97-8129-011d7477e610 of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ca828ba4-8a47-472f-88f9-32109225514e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] create volume s_ca828ba4-8a47-472f-88f9-32109225514e from snapshot s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:22:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_680b7f39-b5c0-4b97-8129-011d7477e610 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] snapshot v_680b7f39-b5c0-4b97-8129-011d7477e610 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.quota [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Created reservations ['e417844e-8f2b-4ed7-8434-d8827904dc41', 'f950fdd5-b6d6-4b50-9876-14d6d7b2bf51', '5b2fd70d-a306-4094-b309-6c1a50320434', 'dc954d69-dca0-40ef-917b-4d3d6f080bf4'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_ca828ba4-8a47-472f-88f9-32109225514e', 'is_clone': True, 'full_name': 'Pool-0/s_ca828ba4-8a47-472f-88f9-32109225514e', 'name': 's_ca828ba4-8a47-472f-88f9-32109225514e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] volume s_ca828ba4-8a47-472f-88f9-32109225514e properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:22:11 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6ab51dc3-9eea-4a52-a335-e6f888448b0b tempest-SnapshotsActionsTest-2095277883 None] Create snapshot completed successfully Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.coordination [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Acquiring lock "cinder-ca828ba4-8a47-472f-88f9-32109225514e-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.coordination [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-ca828ba4-8a47-472f-88f9-32109225514e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] deleating snapshot s_ca828ba4-8a47-472f-88f9-32109225514e. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] get snapshots for volume s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238332928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.manager [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:11 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Deleted volume successfully. Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6bc49f89-933e-4074-9b37-8b1576cc9256 tempest-VolumesCloneTest-1249171373 None] Lock "cinder-680b7f39-b5c0-4b97-8129-011d7477e610-delete_volume" released by "delete_volume" :: held 3.733s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (76be802a-bdc1-41dd-b463-0664758ff728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54af9f23-09e7-484e-b884-3a638a10f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54af9f23-09e7-484e-b884-3a638a10f840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1837160620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=631ac1af-ff4f-4d96-bbdc-14f3adae1df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:12Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7340b43a-98a5-49ea-8e45-94309d808dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7340b43a-98a5-49ea-8e45-94309d808dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6af1220-40fd-46e1-beac-03c722e876b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6af1220-40fd-46e1-beac-03c722e876b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'volume_name': 'volume-631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511ff9de-e96d-47f6-84b3-57f0575039a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511ff9de-e96d-47f6-84b3-57f0575039a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b32938-8836-45db-9834-e40e3550969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:11 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Volume 631ac1af-ff4f-4d96-bbdc-14f3adae1df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'volume_size': 1} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] creating volume v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] create volume {'name': 'v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] get volume s_ca828ba4-8a47-472f-88f9-32109225514e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_ca828ba4-8a47-472f-88f9-32109225514e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ca828ba4-8a47-472f-88f9-32109225514e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447538', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115114', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9011513674891379682', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b2aeea1079578fdd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238263296', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87264', 'name': 's_ca828ba4-8a47-472f-88f9-32109225514e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] delete snapshot s_ca828ba4-8a47-472f-88f9-32109225514e of volume v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'is_clone': False, 'name': 'v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b32938-8836-45db-9834-e40e3550969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847b40d9-2745-441f-b60f-6bce06c15b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Volume volume-631ac1af-ff4f-4d96-bbdc-14f3adae1df8 (631ac1af-ff4f-4d96-bbdc-14f3adae1df8): created successfully Apr 14 04:22:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847b40d9-2745-441f-b60f-6bce06c15b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (76be802a-bdc1-41dd-b463-0664758ff728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-baa66e2e-c3e6-4fde-8991-cdc34b8487e0 tempest-VolumesCloneTest-1249171373 None] Created volume successfully. Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (6edeef5a-2942-4a71-88da-2ac5d89645c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c75f5-5465-4f96-9d6e-3b32c06941b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c75f5-5465-4f96-9d6e-3b32c06941b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1309049857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=945cd618-347c-4cbf-bed6-28402068dc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=631ac1af-ff4f-4d96-bbdc-14f3adae1df8,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:14Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43865b49-8eb7-4899-aba4-3d5e08c390b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43865b49-8eb7-4899-aba4-3d5e08c390b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed50faf8-a06b-4b2b-9eb6-f1f9fc324fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_ca828ba4-8a47-472f-88f9-32109225514e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] snapshot s_ca828ba4-8a47-472f-88f9-32109225514e deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed50faf8-a06b-4b2b-9eb6-f1f9fc324fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '945cd618-347c-4cbf-bed6-28402068dc04', 'volume_name': 'volume-945cd618-347c-4cbf-bed6-28402068dc04', 'volume_size': 2, 'source_volid': '631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'source_volstatus': 'available'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6c0317-20de-4c4c-9b40-b4b62de64edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6c0317-20de-4c4c-9b40-b4b62de64edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9f5451-984b-44ba-961d-5d86f261b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:14 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Volume 945cd618-347c-4cbf-bed6-28402068dc04: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-945cd618-347c-4cbf-bed6-28402068dc04', 'volume_size': 2, 'source_volid': '631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'source_volstatus': 'available'} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.quota [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Created reservations ['ec784081-3741-490a-a8ed-3c7d245340d5', '6d30444d-85ba-4068-b192-5629f3f02350', '63d1d56e-9092-41fc-9c85-0a8e1803d1de', '33579e2a-7d09-4ddd-af56-5333f34f2d23'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:DELETE=1,cinder:INSERT=9 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] cloned volume 631ac1af-ff4f-4d96-bbdc-14f3adae1df8 to 945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] cloning v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 to v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] create snapshot v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Delete snapshot completed successfully. Apr 14 04:22:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-15415a94-4ce0-4639-afae-20bf4b0cad02 tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-ca828ba4-8a47-472f-88f9-32109225514e-delete_snapshot" released by "delete_snapshot" :: held 2.951s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] create snapshot f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 for volume f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] cloning v_f68baca6-c7bf-4426-9981-6b854e129b7b to s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] create snapshot s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:15 user sudo[88493]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Apr 14 04:22:15 user sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_945cd618-347c-4cbf-bed6-28402068dc04'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] create volume v_945cd618-347c-4cbf-bed6-28402068dc04 from snapshot v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:16 user sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 1.146s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIRreYbm', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23131353939373437', 'path': '/dev/sdi'}), 'kwargs': {'force': True}}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.046s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[4966ead3-367c-46ba-83fc-2df916dd7591]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 04:22:16 user cinder-volume[73393]: No targets found. Apr 14 04:22:16 user cinder-volume[73393]: iSNS: Apr 14 04:22:16 user cinder-volume[73393]: No targets found. Apr 14 04:22:16 user cinder-volume[73393]: STATIC: Apr 14 04:22:16 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 Apr 14 04:22:16 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:22:16 user cinder-volume[73393]: Iface Name: default Apr 14 04:22:16 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e Apr 14 04:22:16 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:22:16 user cinder-volume[73393]: Iface Name: default Apr 14 04:22:16 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 Apr 14 04:22:16 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:22:16 user cinder-volume[73393]: Iface Name: default Apr 14 04:22:16 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 Apr 14 04:22:16 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:22:16 user cinder-volume[73393]: Iface Name: default Apr 14 04:22:16 user cinder-volume[73393]: FIRMWARE: Apr 14 04:22:16 user cinder-volume[73393]: No targets found. Apr 14 04:22:16 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 04:22:16 user cinder-volume[73393]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 04:22:16 user cinder-volume[73393]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73393) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449', 0)] {{(pid=73393) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e1219e-f3a8-40fd-8943-af9a3f12d205]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf44c48-452a-4af5-a55b-1789c3c3d79c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 (non-flash) Apr 14 04:22:16 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Resulting device map defaultdict(. at 0x7fd683bf2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449'): ({'sdi'}, set())}) {{(pid=73393) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Removing single pathed devices sdi {{(pid=73393) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[4716972a-f9ec-4c0f-85ec-d8bf68255c7e]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8@v_945cd618-347c-4cbf-bed6-28402068dc04', 'is_clone': True, 'full_name': 'Pool-0/v_945cd618-347c-4cbf-bed6-28402068dc04', 'name': 'v_945cd618-347c-4cbf-bed6-28402068dc04'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] get volume v_945cd618-347c-4cbf-bed6-28402068dc04 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[0732d186-c8ba-4d95-be55-1eb2742a679a]: (4, ('ok\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Flushing IO for device /dev/sdi {{(pid=73393) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] terminate connection for f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:22:16 user cinder-volume[73393]: INFO cinder.volume.manager [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Terminate volume connection completed successfully. Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Deleting attachment 6510384b-b7d8-458c-8e4c-bc14aa6c7bd4. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] remove_export for volume: f2d01790-bd9f-4eff-aa4d-2248429aeb94. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2019879053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f2d01790-bd9f-4eff-aa4d-2248429aeb94,launched_at=2023-04-14T04:19:57Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth='CHAP FdyQafHs 4ALeOqymcn0XtT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:20:21Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] detach volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 from target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f90f50e-35c9-4034-b5c0-a8f6c4c6eba3]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73393) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] create volume s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 from snapshot s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec4c807-1d78-4be4-a45e-d2705bfc7ed9]: (4, ('1', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=73393) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] SCSI volumes sdi have been removed. {{(pid=73393) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449')] {{(pid=73393) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8@v_945cd618-347c-4cbf-bed6-28402068dc04', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_945cd618-347c-4cbf-bed6-28402068dc04', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447544', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115136', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5334503558029847566', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0bfc3396186d47b5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238201856', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87998', 'name': 'v_945cd618-347c-4cbf-bed6-28402068dc04', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Extend volume 945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] jdss extend volume v_945cd618-347c-4cbf-bed6-28402068dc04 to 2147483648 {{(pid=73393) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[f963a58f-7ac0-41f7-a8d5-b4aaa11ade5f]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --logout {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee0247-63c0-4609-94f0-27bbd3fc718f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260] Apr 14 04:22:16 user cinder-volume[73393]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449, portal: 172.16.0.220,3260] successful. Apr 14 04:22:16 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:22:16 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op delete {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a7fbe5-4990-4e9a-be33-f54e2ff58c88]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] <== disconnect_volume: return (402ms) None {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] terminate connection for 16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] volume 16203803-41c1-4da7-804c-d344751cb449: removing export {{(pid=73393) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] remove_export for volume: 16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355191391',ec2_id=None,encryption_key_id=None,glance_metadata={},group=,group_id=None,host='user@joviandss-2#joviandss-2',id=16203803-41c1-4da7-804c-d344751cb449,launched_at=2023-04-14T04:16:19Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='280aa55745a749b7baa134334d25c9c3',provider_auth='CHAP wIRreYbm CcQBFaRTqU9NoM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:18Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='uploading',terminated_at=None,updated_at=2023-04-14T04:21:46Z,use_quota=True,user_id='6e422970cd8340bf996a135088094f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] detach volume v_16203803-41c1-4da7-804c-d344751cb449 from target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9f5451-984b-44ba-961d-5d86f261b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945cd618-347c-4cbf-bed6-28402068dc04', 'volume_size': 2, 'source_volid': '631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'source_volstatus': 'available'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b1bd7e-9007-4710-89dd-c85ac5986157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:17 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Volume volume-945cd618-347c-4cbf-bed6-28402068dc04 (945cd618-347c-4cbf-bed6-28402068dc04): created successfully Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b1bd7e-9007-4710-89dd-c85ac5986157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Flow 'volume_create_manager' (6edeef5a-2942-4a71-88da-2ac5d89645c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:17 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5be76ae3-67dc-4ab4-93d3-35a8ee1dfe3d tempest-VolumesCloneTest-1249171373 None] Created volume successfully. Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] delete target: iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] delete target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] delete target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] delete target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Acquiring lock "cinder-945cd618-347c-4cbf-bed6-28402068dc04-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Lock "cinder-945cd618-347c-4cbf-bed6-28402068dc04-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7', 'is_clone': True, 'full_name': 'Pool-0/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7', 'name': 's_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] remove_export for volume: 945cd618-347c-4cbf-bed6-28402068dc04. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1309049857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=945cd618-347c-4cbf-bed6-28402068dc04,launched_at=2023-04-14T04:22:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth='CHAP uAIPbWOR JHTsM9kYdSXg6e',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=631ac1af-ff4f-4d96-bbdc-14f3adae1df8,status='deleting',terminated_at=2023-04-14T04:22:18Z,updated_at=2023-04-14T04:22:18Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] detach volume v_945cd618-347c-4cbf-bed6-28402068dc04 from target iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04/luns/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04/luns/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04/luns/v_945cd618-347c-4cbf-bed6-28402068dc04'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04/luns/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 because of JDSS resource v_945cd618-347c-4cbf-bed6-28402068dc04 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] delete target: iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] delete target iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] volume s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 because of JDSS resource iqn.2010-10.org.openstack:945cd618-347c-4cbf-bed6-28402068dc04 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] deleating volume v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] get snapshots for volume v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:17 user cinder-volume[73393]: INFO cinder.volume.manager [None req-24aabda9-bddc-4c28-aff6-fc8567056f7f tempest-SnapshotsActionsTest-2095277883 None] Create snapshot completed successfully Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-f0930474-0f76-4ef3-b91a-7a4289ac0e14 tempest-TaggedBootDevicesTest-914882220 None] target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] terminate connection for 40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:22:17 user cinder-volume[73393]: INFO cinder.volume.manager [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Terminate volume connection completed successfully. Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Deleting attachment c67610e7-bec4-4bc4-966e-21da3a7669f1. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] remove_export for volume: 40e8dfdd-c6e4-4f7f-a465-913fe79829ac. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2144330636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=40e8dfdd-c6e4-4f7f-a465-913fe79829ac,launched_at=2023-04-14T04:19:59Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth='CHAP aEOFgACW 20SXuvWjktEKHl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:58Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:20:26Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] detach volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac from target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Uploaded volume to glance image-id: c42cbcb0-cfa7-4329-88ce-aae460a99303. {{(pid=73393) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1793}} Apr 14 04:22:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d9ff519c-cf64-4b03-a520-c5384bae789c tempest-VolumesActionsTest-447148503 None] Copy volume to image completed successfully. Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] get volume v_945cd618-347c-4cbf-bed6-28402068dc04 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8@v_945cd618-347c-4cbf-bed6-28402068dc04', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_945cd618-347c-4cbf-bed6-28402068dc04', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447544', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115136', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5334503558029847566', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0bfc3396186d47b5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238095360', 'san:volume_id': '0bfc3396186d47b5622466519df4b706ce40acc7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87998', 'name': 'v_945cd618-347c-4cbf-bed6-28402068dc04', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] delete snapshot v_945cd618-347c-4cbf-bed6-28402068dc04 of volume v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Acquiring lock "cinder-f6fc6d01-af6d-43fc-ac78-7ce74df44fc7-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-f6fc6d01-af6d-43fc-ac78-7ce74df44fc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] deleating snapshot s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] get snapshots for volume s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] delete target: iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] delete target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] get volume s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-97ab7c48-9b9e-47bd-8478-79ce5c3a5295 tempest-TaggedBootDevicesTest-914882220 None] target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447545', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115141', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11965284217568323368', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4037de0ceba2b31f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238177280', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88320', 'name': 's_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] delete snapshot s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 of volume v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] terminate connection for 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:22:19 user cinder-volume[73393]: INFO cinder.volume.manager [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Terminate volume connection completed successfully. Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Deleting attachment 4259a8d9-79de-44fa-afcc-18b419dfaf6c. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] remove_export for volume: 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-314191079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e5988ce-8d0a-49a0-acc8-84f7d3917bd3,launched_at=2023-04-14T04:20:01Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth='CHAP WspLiGZN EBbSCWOmtGe1Rx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:00Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:20:33Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] detach volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 from target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] terminate connection for b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:22:19 user cinder-volume[73393]: INFO cinder.volume.manager [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Terminate volume connection completed successfully. Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Deleting attachment f57596f4-3157-4f5b-b9aa-52470f8dbf1c. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] remove_export for volume: b7e94002-3eeb-442d-b224-ef83dacfa5a4. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2034099743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b7e94002-3eeb-442d-b224-ef83dacfa5a4,launched_at=2023-04-14T04:18:27Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth='CHAP mfOroQgL sDeC2NEGSfc6Ai',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:26Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:22:19Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] detach volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 from target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots/v_945cd618-347c-4cbf-bed6-28402068dc04 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] snapshot v_945cd618-347c-4cbf-bed6-28402068dc04 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=69,cinder:UPDATE=19,cinder:DELETE=6,cinder:INSERT=6 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:19 user cinder-volume[73393]: DEBUG cinder.quota [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Created reservations ['2e2ff8bf-edd6-4ae0-b220-f1274bbb8732', '53fc6d49-6af4-474b-a200-bbd6daa315d1', 'c38f9d41-ffc6-4e27-9963-937f90d59876', '3a6873ac-98fc-4d28-833f-2d37e735e12d'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Acquiring lock "cinder-16203803-41c1-4da7-804c-d344751cb449-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] remove_export for volume: 16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355191391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=16203803-41c1-4da7-804c-d344751cb449,launched_at=2023-04-14T04:16:19Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='280aa55745a749b7baa134334d25c9c3',provider_auth='CHAP wIRreYbm CcQBFaRTqU9NoM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:16:18Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:20Z,updated_at=2023-04-14T04:22:20Z,use_quota=True,user_id='6e422970cd8340bf996a135088094f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] detach volume v_16203803-41c1-4da7-804c-d344751cb449 from target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] delete target: iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] delete target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-35eed0d4-ee97-4054-a296-2c72f10a8926 req-aa413715-2e0d-44d2-9ad7-3f2bcab39ec5 tempest-AttachVolumeTestJSON-991906288 None] target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449/luns/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] failed to remove resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 because of JDSS resource v_16203803-41c1-4da7-804c-d344751cb449 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] delete target: iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] delete target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] failed to remove resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 because of JDSS resource iqn.2010-10.org.openstack:16203803-41c1-4da7-804c-d344751cb449 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] deleating volume v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] get snapshots for volume v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238164992', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.manager [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:20 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Deleted volume successfully. Apr 14 04:22:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fc271700-238b-41cd-b011-f3cdc07e58c3 tempest-VolumesCloneTest-1249171373 None] Lock "cinder-945cd618-347c-4cbf-bed6-28402068dc04-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] get volume v_16203803-41c1-4da7-804c-d344751cb449 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_16203803-41c1-4da7-804c-d344751cb449', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447187', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114768', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14703112192671264475', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '11599747eb90e35b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238201856', 'san:volume_id': '11599747eb90e35b518566957fda54b4b21a126f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87104', 'name': 'v_16203803-41c1-4da7-804c-d344751cb449', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] delete volume:v_16203803-41c1-4da7-804c-d344751cb449 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Acquiring lock "cinder-631ac1af-ff4f-4d96-bbdc-14f3adae1df8-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Lock "cinder-631ac1af-ff4f-4d96-bbdc-14f3adae1df8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] remove_export for volume: 631ac1af-ff4f-4d96-bbdc-14f3adae1df8. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1837160620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=631ac1af-ff4f-4d96-bbdc-14f3adae1df8,launched_at=2023-04-14T04:22:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed395d23320a420b9e5591e6d8b82b1a',provider_auth='CHAP EzdcTinM 7FSMyn5IwmATZx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:12Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:21Z,updated_at=2023-04-14T04:22:21Z,use_quota=True,user_id='19184f69ee5541ee89fb01849219c42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] detach volume v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 from target iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8/luns/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8/luns/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8/luns/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8/luns/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 because of JDSS resource v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] delete target: iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] delete target iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] failed to remove resource iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 because of JDSS resource iqn.2010-10.org.openstack:631ac1af-ff4f-4d96-bbdc-14f3adae1df8 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] deleating volume v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] get snapshots for volume v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] snapshot s_f6fc6d01-af6d-43fc-ac78-7ce74df44fc7 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.quota [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Created reservations ['9339e86b-ada5-40a9-af83-18df4e851837', 'd2d2a647-0928-46a4-a45e-2fdfc344a7d4', 'da2eaa98-f0a0-4648-9243-451b503df7b1', '5ec62d96-c630-4e79-a44c-e62260a513bf'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Delete snapshot completed successfully. Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f55627ed-a136-4e92-95d7-55f4554b083d tempest-SnapshotsActionsTest-601333089 None] Lock "cinder-f6fc6d01-af6d-43fc-ac78-7ce74df44fc7-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] get volume v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] delete target: iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] delete target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447541', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115125', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14153447632206905436', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '02a499edba0a60e4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238201856', 'san:volume_id': '02a499edba0a60e47095ff67e6d3ab06bd12dd0b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87280', 'name': 'v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] delete volume:v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 req-bf2e55a4-d051-434e-a578-e08a156241b3 tempest-TaggedBootDevicesTest-914882220 None] target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16203803-41c1-4da7-804c-d344751cb449 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] volume v_16203803-41c1-4da7-804c-d344751cb449 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Created reservations ['d40ef238-055c-4fe1-bbcf-7e89033fa9c1', 'b1252c1c-1bf4-4460-bc81-e44c356e8de9', 'ecba631b-57c0-4cf4-8aa4-3ddb6275d4b3', 'f9dd2ad8-d95d-47c6-b144-6e4f2c2e65fe'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Acquiring lock "cinder-8db4069a-efaf-4c46-88f4-62ec575a5872-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Lock "cinder-8db4069a-efaf-4c46-88f4-62ec575a5872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] deleating snapshot s_8db4069a-efaf-4c46-88f4-62ec575a5872. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] get snapshots for volume s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] get volume s_8db4069a-efaf-4c46-88f4-62ec575a5872 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b@s_8db4069a-efaf-4c46-88f4-62ec575a5872', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_8db4069a-efaf-4c46-88f4-62ec575a5872', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447517', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115066', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16341399193402339472', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '36c8fc16ba70c25e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238402560', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87914', 'name': 's_8db4069a-efaf-4c46-88f4-62ec575a5872', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] delete snapshot s_8db4069a-efaf-4c46-88f4-62ec575a5872 of volume v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238402560', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Deleted volume successfully. Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0b36b9e0-95f0-4abf-b17f-930cc79b4cfc tempest-VolumesActionsTest-447148503 None] Lock "cinder-16203803-41c1-4da7-804c-d344751cb449-delete_volume" released by "delete_volume" :: held 4.001s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Flow 'volume_create_manager' (ef5342aa-b058-463d-bc0a-1a5b6006eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcb5316-24b5-461e-b079-5170471f90e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcb5316-24b5-461e-b079-5170471f90e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-164022579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=76b8598c-a7c5-4cc7-bd79-eb7d98b3da66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d389bb78d2e40b9b07d2d3ecdb7566b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:25Z,use_quota=True,user_id='d2561bbc0c6d447da333ffdbb9fdc5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f3fedc-55c0-439e-b103-9c8a15592d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f3fedc-55c0-439e-b103-9c8a15592d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d523d9a4-2c29-4cb4-9e09-3d297551e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d523d9a4-2c29-4cb4-9e09-3d297551e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'volume_name': 'volume-76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dc14dd-b74f-4162-b859-e04a0e2cefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dc14dd-b74f-4162-b859-e04a0e2cefac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b048159-8556-4269-a7d8-fb96748d37ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:24 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Volume 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'volume_size': 1} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] creating volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] create volume {'name': 'v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] volume v_631ac1af-ff4f-4d96-bbdc-14f3adae1df8 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=31,cinder:SELECT=59,cinder:INSERT=9,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.quota [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Created reservations ['4bfb4023-8b36-4a9c-8a8f-04ec7cd65b17', 'cf055b3b-2b99-4c43-b50b-e6d575cffd7f', 'cc19886d-18e6-4b86-9320-42c1d2b5fb6b', 'a83bce73-d203-4a32-8818-79cfb110d1b6'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238390272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'is_clone': False, 'name': 'v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b048159-8556-4269-a7d8-fb96748d37ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e2369f-df67-4bba-878a-6a530abfd579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:25 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Volume volume-76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 (76b8598c-a7c5-4cc7-bd79-eb7d98b3da66): created successfully Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e2369f-df67-4bba-878a-6a530abfd579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Flow 'volume_create_manager' (ef5342aa-b058-463d-bc0a-1a5b6006eb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-cb1f1072-8687-450a-89c1-a38ccbad204f tempest-VolumesAdminNegativeTest-618964915 None] Created volume successfully. Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots/s_8db4069a-efaf-4c46-88f4-62ec575a5872 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] snapshot s_8db4069a-efaf-4c46-88f4-62ec575a5872 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.quota [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Created reservations ['b6d7ac80-279b-4382-93a2-55789d91db67', '86476d5e-bf38-4da4-9570-92cde27e7bc5', '4fa1e09b-352b-4bcb-8528-cee4562bfb42', 'ad9dddaf-acd1-478c-be2a-31d5610a5c0b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Delete snapshot completed successfully. Apr 14 04:22:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0c21823c-8f7c-457e-9d2c-e1df085537c1 tempest-SnapshotsActionsTest-2095277883 None] Lock "cinder-8db4069a-efaf-4c46-88f4-62ec575a5872-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238308352', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.manager [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:26 user cinder-volume[73393]: INFO cinder.volume.manager [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Deleted volume successfully. Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.coordination [None req-70186f16-f917-4aa9-961f-ec65d06f8a0d tempest-VolumesCloneTest-1249171373 None] Lock "cinder-631ac1af-ff4f-4d96-bbdc-14f3adae1df8-delete_volume" released by "delete_volume" :: held 5.257s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.coordination [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Acquiring lock "cinder-f68baca6-c7bf-4426-9981-6b854e129b7b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.coordination [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Lock "cinder-f68baca6-c7bf-4426-9981-6b854e129b7b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] remove_export for volume: f68baca6-c7bf-4426-9981-6b854e129b7b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1148934730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f68baca6-c7bf-4426-9981-6b854e129b7b,launched_at=2023-04-14T04:21:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0115fddb9d443ea0f3ba6000da2fe7',provider_auth='CHAP XupWIBwh Ye5jKuxNCgMcdJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:45Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:27Z,updated_at=2023-04-14T04:22:27Z,use_quota=True,user_id='e1bed0ff9a514f3bb4eac8c8d2d614fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] detach volume v_f68baca6-c7bf-4426-9981-6b854e129b7b from target iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b/luns/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b/luns/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b/luns/v_f68baca6-c7bf-4426-9981-6b854e129b7b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b/luns/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] failed to remove resource iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b because of JDSS resource v_f68baca6-c7bf-4426-9981-6b854e129b7b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] delete target: iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] delete target iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] failed to remove resource iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b because of JDSS resource iqn.2010-10.org.openstack:f68baca6-c7bf-4426-9981-6b854e129b7b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] deleating volume v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] get snapshots for volume v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] get volume v_f68baca6-c7bf-4426-9981-6b854e129b7b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f68baca6-c7bf-4426-9981-6b854e129b7b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447514', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115060', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15090286460743516569', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bede883b5e7f944b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238308352', 'san:volume_id': 'bede883b5e7f944be9dbdd2fd8d3a0e57ac09ddd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86504', 'name': 'v_f68baca6-c7bf-4426-9981-6b854e129b7b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] delete volume:v_f68baca6-c7bf-4426-9981-6b854e129b7b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] create export for volume: 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] ensure volume 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] check if targe iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=56,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=9 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Flow 'volume_create_manager' (5078c696-76a7-47c8-a137-22534f790313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c719cd5-9258-4f91-bb6a-775e4221ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c719cd5-9258-4f91-bb6a-775e4221ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2088589063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c61f6e25-4530-44b6-8af8-e6eb35c044a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95d75f88feee434b9aecc851255449bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:28Z,use_quota=True,user_id='6413949bddb145bdb914b58e18b18bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afa8f74-5390-47d8-a22b-49f480e0103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afa8f74-5390-47d8-a22b-49f480e0103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1741a556-57fb-4395-9a3b-5477e423bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1741a556-57fb-4395-9a3b-5477e423bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'volume_name': 'volume-c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25342c4d-8049-471f-a28e-30cfc442f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25342c4d-8049-471f-a28e-30cfc442f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8376b738-58c7-48ed-9960-320b7dabf187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Volume c61f6e25-4530-44b6-8af8-e6eb35c044a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'volume_size': 1} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] creating volume v_c61f6e25-4530-44b6-8af8-e6eb35c044a0. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] create volume {'name': 'v_c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (3ebaa284-4a3c-4218-9883-30570c353238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a148d6d-b920-4bc3-a713-75c998c72130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a148d6d-b920-4bc3-a713-75c998c72130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-813561633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9113785-28aa-46da-ae7d-d2f2e9a011b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:28Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ceeeb0-9ca8-4d71-acf1-f4b1a41f1477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ceeeb0-9ca8-4d71-acf1-f4b1a41f1477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ed546d-e28d-4073-975e-d8a92f8f048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ed546d-e28d-4073-975e-d8a92f8f048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'volume_name': 'volume-b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816bb791-db6a-42db-b898-1b0040cc2829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816bb791-db6a-42db-b898-1b0040cc2829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9fc8fe-2512-40b3-8edf-f4febe17cabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Volume b9113785-28aa-46da-ae7d-d2f2e9a011b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'volume_size': 1} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] creating volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] create volume {'name': 'v_b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'is_clone': False, 'name': 'v_c61f6e25-4530-44b6-8af8-e6eb35c044a0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8376b738-58c7-48ed-9960-320b7dabf187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8647de82-bef9-4a05-8bac-4c9f6fbcb974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Volume volume-c61f6e25-4530-44b6-8af8-e6eb35c044a0 (c61f6e25-4530-44b6-8af8-e6eb35c044a0): created successfully Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8647de82-bef9-4a05-8bac-4c9f6fbcb974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Flow 'volume_create_manager' (5078c696-76a7-47c8-a137-22534f790313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a8b705dd-ec0e-472f-a6ac-ec1f8a13947e tempest-VolumesListTestJSON-1671593894 None] Created volume successfully. Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f68baca6-c7bf-4426-9981-6b854e129b7b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] volume v_f68baca6-c7bf-4426-9981-6b854e129b7b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] create target and attach volume 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] create target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.quota [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Created reservations ['19d7594b-6802-4229-8c89-4f08633dc547', 'af084020-6b5b-46ae-b97e-093fc12db044', '881bc5b4-d259-4681-958f-a90ea6ca1fb0', '4602e5e1-3aa8-4b7c-a2a8-57aee8b782b1'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'is_clone': False, 'name': 'v_b9113785-28aa-46da-ae7d-d2f2e9a011b2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9fc8fe-2512-40b3-8edf-f4febe17cabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d545b9-beff-4abb-bf2c-158d5eb4fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:29 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Volume volume-b9113785-28aa-46da-ae7d-d2f2e9a011b2 (b9113785-28aa-46da-ae7d-d2f2e9a011b2): created successfully Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d545b9-beff-4abb-bf2c-158d5eb4fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (3ebaa284-4a3c-4218-9883-30570c353238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8b2a054e-a538-41c7-a503-0751d04a38dd tempest-VolumesSnapshotTestJSON-1226436274 None] Created volume successfully. Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238275584', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.manager [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Deleted volume successfully. Apr 14 04:22:29 user cinder-volume[73393]: DEBUG cinder.coordination [None req-371b933a-a962-4b87-bc7d-dd300882decc tempest-SnapshotsActionsTest-2095277883 None] Lock "cinder-f68baca6-c7bf-4426-9981-6b854e129b7b-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Flow 'volume_create_manager' (11e53457-969d-4054-8eca-39445e8c129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6833fc20-8473-438b-8965-6148906c4428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6833fc20-8473-438b-8965-6148906c4428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-255689863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9dae5837-47c7-4531-8ab8-8aa409798019,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95d75f88feee434b9aecc851255449bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:30Z,use_quota=True,user_id='6413949bddb145bdb914b58e18b18bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5493b351-a218-4a9b-949b-b1ec7d4d95e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5493b351-a218-4a9b-949b-b1ec7d4d95e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de59c071-d0be-4de4-a6b9-2b2dafad98e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de59c071-d0be-4de4-a6b9-2b2dafad98e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dae5837-47c7-4531-8ab8-8aa409798019', 'volume_name': 'volume-9dae5837-47c7-4531-8ab8-8aa409798019', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418ac677-6b0c-4d6c-bf84-5e3a1afcbd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418ac677-6b0c-4d6c-bf84-5e3a1afcbd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c53eca-0dfd-4f36-a880-a9eec83877d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:30 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Volume 9dae5837-47c7-4531-8ab8-8aa409798019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dae5837-47c7-4531-8ab8-8aa409798019', 'volume_size': 1} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] creating volume v_9dae5837-47c7-4531-8ab8-8aa409798019. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] create volume {'name': 'v_9dae5837-47c7-4531-8ab8-8aa409798019', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (6c6b0932-0395-4631-98b7-0aed8f75d32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deea4261-86e9-47fb-8484-93d7f7554052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deea4261-86e9-47fb-8484-93d7f7554052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-476306892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=de74dbb1-1657-4193-9520-50cfa823199b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:31Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d955ffa1-bea9-442f-82e1-594b43f1bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d955ffa1-bea9-442f-82e1-594b43f1bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89de47dd-83a5-4e6e-b628-e16a5fd64955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89de47dd-83a5-4e6e-b628-e16a5fd64955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de74dbb1-1657-4193-9520-50cfa823199b', 'volume_name': 'volume-de74dbb1-1657-4193-9520-50cfa823199b', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8120a504-e9f7-41ac-b0b4-28add36bb658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8120a504-e9f7-41ac-b0b4-28add36bb658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086fef36-2ab0-4798-bde5-b1dc8abe7e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:31 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume de74dbb1-1657-4193-9520-50cfa823199b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de74dbb1-1657-4193-9520-50cfa823199b', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Cloning de74dbb1-1657-4193-9520-50cfa823199b from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 22, 31, 36879)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 22, 31, 53525)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9dae5837-47c7-4531-8ab8-8aa409798019', 'is_clone': False, 'name': 'v_9dae5837-47c7-4531-8ab8-8aa409798019'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c53eca-0dfd-4f36-a880-a9eec83877d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dae5837-47c7-4531-8ab8-8aa409798019', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bced3226-83fa-4a42-a14c-f55dea8abd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:31 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Volume volume-9dae5837-47c7-4531-8ab8-8aa409798019 (9dae5837-47c7-4531-8ab8-8aa409798019): created successfully Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bced3226-83fa-4a42-a14c-f55dea8abd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Flow 'volume_create_manager' (11e53457-969d-4054-8eca-39445e8c129f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b6a9ce5e-fc63-4d9a-a155-51cc96651463 tempest-VolumesListTestJSON-1671593894 None] Created volume successfully. Apr 14 04:22:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] atach volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 to target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:22:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_de74dbb1-1657-4193-9520-50cfa823199b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume v_de74dbb1-1657-4193-9520-50cfa823199b from snapshot v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Flow 'volume_create_manager' (ef7f01f2-e748-425f-8bdd-83f08bd31c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e88138-2dfa-451a-a270-dcbca1601a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e88138-2dfa-451a-a270-dcbca1601a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-425649385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=35a281e1-de8d-43e0-831e-0837f25cafcb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95d75f88feee434b9aecc851255449bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:33Z,use_quota=True,user_id='6413949bddb145bdb914b58e18b18bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108dbf94-0109-4e21-aed6-cc07ed7d5fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108dbf94-0109-4e21-aed6-cc07ed7d5fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be503b5-215f-4905-a082-d6aaee34cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be503b5-215f-4905-a082-d6aaee34cfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a281e1-de8d-43e0-831e-0837f25cafcb', 'volume_name': 'volume-35a281e1-de8d-43e0-831e-0837f25cafcb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71019953-da3b-4419-a8f9-8c18441e511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71019953-da3b-4419-a8f9-8c18441e511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb155f6-81ca-4f7d-a33d-8d3f7e4ab0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:33 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Volume 35a281e1-de8d-43e0-831e-0837f25cafcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a281e1-de8d-43e0-831e-0837f25cafcb', 'volume_size': 1} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] creating volume v_35a281e1-de8d-43e0-831e-0837f25cafcb. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] create volume {'name': 'v_35a281e1-de8d-43e0-831e-0837f25cafcb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_35a281e1-de8d-43e0-831e-0837f25cafcb', 'is_clone': False, 'name': 'v_35a281e1-de8d-43e0-831e-0837f25cafcb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb155f6-81ca-4f7d-a33d-8d3f7e4ab0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a281e1-de8d-43e0-831e-0837f25cafcb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6037d808-352b-4d91-ac03-5495caec06ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:34 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Volume volume-35a281e1-de8d-43e0-831e-0837f25cafcb (35a281e1-de8d-43e0-831e-0837f25cafcb): created successfully Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6037d808-352b-4d91-ac03-5495caec06ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Flow 'volume_create_manager' (ef7f01f2-e748-425f-8bdd-83f08bd31c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:34 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1b52a241-1454-45c6-a911-b2504d9e608f tempest-VolumesListTestJSON-1671593894 None] Created volume successfully. Apr 14 04:22:34 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=38,cinder:SELECT=53,cinder:INSERT=4,cinder:DELETE=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3039666264653836', 'lun': 0, 'mode': 'wt', 'name': 'v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'prod_id': 'Storage', 'scsi_id': '09fbde8626da8717'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] add credentails to target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Flow 'volume_create_manager' (7ada40fe-efd0-43c7-95cf-ff9d584ea5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d33101-ee23-468e-8521-f9831ae77561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d33101-ee23-468e-8521-f9831ae77561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-629347159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee85cd94d146afbdc6e8de108dcc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:35Z,use_quota=True,user_id='f093fc63411f4d479672bd13d32b33e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed0c6cc-3186-4b78-9a5b-62599b60ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed0c6cc-3186-4b78-9a5b-62599b60ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960f8ac2-d814-4c6a-a406-55ee3ff70527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960f8ac2-d814-4c6a-a406-55ee3ff70527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'volume_name': 'volume-c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84662ce8-dc91-431b-932a-6ef2d0ca4a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84662ce8-dc91-431b-932a-6ef2d0ca4a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7b50eb-3d76-4d04-b6b1-caa46357d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Volume c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'volume_size': 1} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] creating volume v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] create volume {'name': 'v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_de74dbb1-1657-4193-9520-50cfa823199b', 'is_clone': True, 'full_name': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b', 'name': 'v_de74dbb1-1657-4193-9520-50cfa823199b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_de74dbb1-1657-4193-9520-50cfa823199b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 201, 'error': None, 'data': {'name': 'kSWhTJji'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] initialize_connection for 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSWhTJji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '20019e69-02d4-4f64-91b2-d7792a3f9cf3'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_de74dbb1-1657-4193-9520-50cfa823199b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447563', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115185', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5013150986778660738', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '78d430bb11d6f89e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237968384', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87589', 'name': 'v_de74dbb1-1657-4193-9520-50cfa823199b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Marking volume de74dbb1-1657-4193-9520-50cfa823199b as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to de74dbb1-1657-4193-9520-50cfa823199b. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Creating volume glance metadata for volume de74dbb1-1657-4193-9520-50cfa823199b backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:22:36 user cinder-volume[73393]: INFO cinder.volume.manager [req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 req-d140cd9e-e6bd-40ea-9d66-2eb6eb4945af tempest-VolumesAdminNegativeTest-618964915 None] attachment_update completed successfully. Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086fef36-2ab0-4798-bde5-b1dc8abe7e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de74dbb1-1657-4193-9520-50cfa823199b', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ececdc9d-5aae-483e-97a9-ffdf96a6db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:36 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume volume-de74dbb1-1657-4193-9520-50cfa823199b (de74dbb1-1657-4193-9520-50cfa823199b): created successfully Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ececdc9d-5aae-483e-97a9-ffdf96a6db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (6c6b0932-0395-4631-98b7-0aed8f75d32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3ea7bd11-8a1e-4459-853b-f03952692f35 tempest-VolumesSnapshotTestJSON-1226436274 None] Created volume successfully. Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'is_clone': False, 'name': 'v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7b50eb-3d76-4d04-b6b1-caa46357d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7608bb24-60f5-4200-95c4-f18dcd652df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:36 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Volume volume-c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 (c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37): created successfully Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7608bb24-60f5-4200-95c4-f18dcd652df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Flow 'volume_create_manager' (7ada40fe-efd0-43c7-95cf-ff9d584ea5c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-900e9d24-be97-42bf-835d-4445fcce3eea tempest-VolumeQuotasAdminTestJSON-2063572223 None] Created volume successfully. Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Acquiring lock "cinder-c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Lock "cinder-c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] remove_export for volume: c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-629347159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37,launched_at=2023-04-14T04:22:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee85cd94d146afbdc6e8de108dcc6b',provider_auth='CHAP bDjcNoZR PyHQTNg45kif9w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:35Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:38Z,updated_at=2023-04-14T04:22:38Z,use_quota=True,user_id='f093fc63411f4d479672bd13d32b33e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] detach volume v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 from target iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37/luns/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37/luns/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37/luns/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37/luns/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] failed to remove resource iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 because of JDSS resource v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] delete target: iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] delete target iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] failed to remove resource iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 because of JDSS resource iqn.2010-10.org.openstack:c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] deleating volume v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] get snapshots for volume v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] get volume v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447564', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115188', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11992932597617890987', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3943a11bb8a46b58', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237919232', 'san:volume_id': '3943a11bb8a46b58e3bca5d87dcdb56b89e96c6d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88332', 'name': 'v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] delete volume:v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Acquiring lock "cinder-35a281e1-de8d-43e0-831e-0837f25cafcb-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Lock "cinder-35a281e1-de8d-43e0-831e-0837f25cafcb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] remove_export for volume: 35a281e1-de8d-43e0-831e-0837f25cafcb. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-425649385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=35a281e1-de8d-43e0-831e-0837f25cafcb,launched_at=2023-04-14T04:22:35Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95d75f88feee434b9aecc851255449bb',provider_auth='CHAP jSJkptbA 7Ry2sDPUuI6HYo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:33Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:39Z,updated_at=2023-04-14T04:22:39Z,use_quota=True,user_id='6413949bddb145bdb914b58e18b18bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] detach volume v_35a281e1-de8d-43e0-831e-0837f25cafcb from target iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb/luns/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb/luns/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb/luns/v_35a281e1-de8d-43e0-831e-0837f25cafcb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb/luns/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] failed to remove resource iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb because of JDSS resource v_35a281e1-de8d-43e0-831e-0837f25cafcb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] delete target: iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] delete target iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] failed to remove resource iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb because of JDSS resource iqn.2010-10.org.openstack:35a281e1-de8d-43e0-831e-0837f25cafcb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] deleating volume v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] get snapshots for volume v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] get volume v_35a281e1-de8d-43e0-831e-0837f25cafcb info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_35a281e1-de8d-43e0-831e-0837f25cafcb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447563', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115177', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6387248024940497971', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '719919165359369f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237919232', 'san:volume_id': '719919165359369fb8e9eb0c62781a75c609531e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88166', 'name': 'v_35a281e1-de8d-43e0-831e-0837f25cafcb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] delete volume:v_35a281e1-de8d-43e0-831e-0837f25cafcb recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] terminate connection for 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:22:40 user cinder-volume[73393]: INFO cinder.volume.manager [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Terminate volume connection completed successfully. Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Deleting attachment 20019e69-02d4-4f64-91b2-d7792a3f9cf3. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] remove_export for volume: 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-164022579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=76b8598c-a7c5-4cc7-bd79-eb7d98b3da66,launched_at=2023-04-14T04:22:26Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3d389bb78d2e40b9b07d2d3ecdb7566b',provider_auth='CHAP kSWhTJji xR980OBDTigGmE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:25Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:22:39Z,use_quota=True,user_id='d2561bbc0c6d447da333ffdbb9fdc5f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] detach volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 from target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] volume v_c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=67,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.quota [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Created reservations ['3520283e-49de-42fd-8b0a-83acbef1286b', 'b468de37-d74f-41c4-8273-a6c863e2386d', 'a43630b5-687d-439b-9204-8dfcb324a9bc', '784225a5-20a4-4928-8f29-d38e27b29976'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Flow 'volume_create_manager' (1aab28a3-f72b-4aff-8ed1-c582fb5b761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3c6824-b39a-41d9-aef1-737963a4877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238070784', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.manager [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:41 user cinder-volume[73393]: INFO cinder.volume.manager [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Deleted volume successfully. Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3c6824-b39a-41d9-aef1-737963a4877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-916799527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=68cab9b8-6018-4f68-9f68-31f4a7a2b76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee85cd94d146afbdc6e8de108dcc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:41Z,use_quota=True,user_id='f093fc63411f4d479672bd13d32b33e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8409e1a-73c3-4e83-aa84-95b10bc1aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8409e1a-73c3-4e83-aa84-95b10bc1aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767db27b-f97d-4a42-aa26-bfab9ca825de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767db27b-f97d-4a42-aa26-bfab9ca825de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'volume_name': 'volume-68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfa7ad4-fa8f-4883-961e-2bb9117d7a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfa7ad4-fa8f-4883-961e-2bb9117d7a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5358ff-b1c5-4d88-90cc-321ccf64670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Volume 68cab9b8-6018-4f68-9f68-31f4a7a2b76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'volume_size': 1} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] creating volume v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] create volume {'name': 'v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-980c8567-5a27-4a5d-907c-c4b682103f08 tempest-VolumeQuotasAdminTestJSON-2063572223 None] Lock "cinder-c31ccf85-e5f3-4d95-ade2-03fa4ec3ee37-delete_volume" released by "delete_volume" :: held 3.786s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35a281e1-de8d-43e0-831e-0837f25cafcb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] volume v_35a281e1-de8d-43e0-831e-0837f25cafcb deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.quota [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Created reservations ['d0018764-e958-43bc-869a-933034425cf6', '5f366bb0-2b5d-433b-b3ae-b02b4da60c00', '62891b54-95c1-4a44-a6e8-04c10d498cb1', 'd9a63a7b-e900-48be-84f1-28a879b62278'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'is_clone': False, 'name': 'v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5358ff-b1c5-4d88-90cc-321ccf64670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cc4e79-ec30-4dda-be20-e13a0fc09ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Volume volume-68cab9b8-6018-4f68-9f68-31f4a7a2b76f (68cab9b8-6018-4f68-9f68-31f4a7a2b76f): created successfully Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cc4e79-ec30-4dda-be20-e13a0fc09ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Flow 'volume_create_manager' (1aab28a3-f72b-4aff-8ed1-c582fb5b761e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] delete target: iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] delete target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-abc5aace-28ac-4f26-a2ad-5634b45aef5a tempest-VolumeQuotasAdminTestJSON-2063572223 None] Created volume successfully. Apr 14 04:22:42 user cinder-volume[73393]: DEBUG cinder.coordination [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Acquiring lock "cinder-9dae5837-47c7-4531-8ab8-8aa409798019-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Lock "cinder-9dae5837-47c7-4531-8ab8-8aa409798019-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=62,cinder:UPDATE=24,cinder:INSERT=12,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] remove_export for volume: 9dae5837-47c7-4531-8ab8-8aa409798019. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-255689863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9dae5837-47c7-4531-8ab8-8aa409798019,launched_at=2023-04-14T04:22:32Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95d75f88feee434b9aecc851255449bb',provider_auth='CHAP mryvWuhi eP3sSDqYZR8oLA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:30Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:43Z,updated_at=2023-04-14T04:22:43Z,use_quota=True,user_id='6413949bddb145bdb914b58e18b18bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] detach volume v_9dae5837-47c7-4531-8ab8-8aa409798019 from target iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019/luns/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019/luns/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019/luns/v_9dae5837-47c7-4531-8ab8-8aa409798019'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019/luns/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] failed to remove resource iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 because of JDSS resource v_9dae5837-47c7-4531-8ab8-8aa409798019 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] delete target: iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] delete target iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] failed to remove resource iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 because of JDSS resource iqn.2010-10.org.openstack:9dae5837-47c7-4531-8ab8-8aa409798019 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] deleating volume v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] get snapshots for volume v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238013440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.manager [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:43 user cinder-volume[73393]: INFO cinder.volume.manager [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Deleted volume successfully. Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-11a28c81-a871-49b5-8c99-fdc32ae1eced tempest-VolumesListTestJSON-1671593894 None] Lock "cinder-35a281e1-de8d-43e0-831e-0837f25cafcb-delete_volume" released by "delete_volume" :: held 4.598s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe53da21-462c-4f86-9fee-2bb335f82587 req-e116bf00-9e33-4959-8cf8-93a4287abb9d tempest-VolumesAdminNegativeTest-618964915 None] target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] get volume v_9dae5837-47c7-4531-8ab8-8aa409798019 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9dae5837-47c7-4531-8ab8-8aa409798019', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447559', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115171', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15173186553474331495', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '08ec71996fd6e2ff', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238013440', 'san:volume_id': '08ec71996fd6e2ffdf9cd502b41b49987d0b6aad', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88153', 'name': 'v_9dae5837-47c7-4531-8ab8-8aa409798019', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] delete volume:v_9dae5837-47c7-4531-8ab8-8aa409798019 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:44 user cinder-volume[73393]: INFO cinder.volume.manager [None req-45fe217c-29ec-485a-9976-672a08207145 tempest-VolumeQuotasAdminTestJSON-823199154 None] Transfer volume completed successfully. Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Acquiring lock "cinder-68cab9b8-6018-4f68-9f68-31f4a7a2b76f-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Lock "cinder-68cab9b8-6018-4f68-9f68-31f4a7a2b76f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] remove_export for volume: 68cab9b8-6018-4f68-9f68-31f4a7a2b76f. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-916799527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=68cab9b8-6018-4f68-9f68-31f4a7a2b76f,launched_at=2023-04-14T04:22:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82461ff7056f470f847e2dac15113f5b',provider_auth='CHAP WsSdwZgu b5NsqCa1SyIozD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:45Z,updated_at=2023-04-14T04:22:45Z,use_quota=True,user_id='1f446a6ee85649e6a324b8126865dbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] detach volume v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f from target iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f/luns/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f/luns/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f/luns/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f/luns/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] failed to remove resource iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f because of JDSS resource v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] delete target: iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] delete target iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] failed to remove resource iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f because of JDSS resource iqn.2010-10.org.openstack:68cab9b8-6018-4f68-9f68-31f4a7a2b76f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] deleating volume v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] get snapshots for volume v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] get volume v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447570', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115195', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '259211424194377590', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '421f91878c4a18a4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238083072', 'san:volume_id': '421f91878c4a18a4fe7d4e15a5062250044ca291', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88711', 'name': 'v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] delete volume:v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9dae5837-47c7-4531-8ab8-8aa409798019 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] volume v_9dae5837-47c7-4531-8ab8-8aa409798019 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.quota [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Created reservations ['0563309e-b47f-4df8-a993-0651770398e6', '882cce78-b9f9-48d3-a569-65124839a85c', 'e25675bf-ac0a-4bb6-ba85-8181013223f8', '6bd9eee5-1148-4d88-893d-4ad72771fdc6'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Acquiring lock "cinder-c61f6e25-4530-44b6-8af8-e6eb35c044a0-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Lock "cinder-c61f6e25-4530-44b6-8af8-e6eb35c044a0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238083072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.manager [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Deleted volume successfully. Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-71cbe1cc-84e2-4ff8-ac7f-3e552b58dafa tempest-VolumesListTestJSON-1671593894 None] Lock "cinder-9dae5837-47c7-4531-8ab8-8aa409798019-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] remove_export for volume: c61f6e25-4530-44b6-8af8-e6eb35c044a0. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2088589063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c61f6e25-4530-44b6-8af8-e6eb35c044a0,launched_at=2023-04-14T04:22:29Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95d75f88feee434b9aecc851255449bb',provider_auth='CHAP lvNgknTX 2rm3ATK4RWLyHf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:46Z,updated_at=2023-04-14T04:22:46Z,use_quota=True,user_id='6413949bddb145bdb914b58e18b18bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] detach volume v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 from target iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0/luns/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0/luns/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0/luns/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0/luns/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] failed to remove resource iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 because of JDSS resource v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] delete target: iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] delete target iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] failed to remove resource iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 because of JDSS resource iqn.2010-10.org.openstack:c61f6e25-4530-44b6-8af8-e6eb35c044a0 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] deleating volume v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] get snapshots for volume v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] get volume v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447557', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115163', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12638379224375771202', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8c65548de112a523', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238164992', 'san:volume_id': '8c65548de112a5231c00ff44558f64e79dd13ae1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88135', 'name': 'v_c61f6e25-4530-44b6-8af8-e6eb35c044a0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] delete volume:v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] volume v_68cab9b8-6018-4f68-9f68-31f4a7a2b76f deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.quota [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Created reservations ['e0e5db02-bb36-4d13-89d0-2a69d7c96de3', '38fb881d-393c-4cd5-9de9-7a895d68fd0d', 'f05b7fea-ea11-4e83-8dcf-45fc7cd64b13', 'e371db08-7e93-44b0-a91e-5634aee93be3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238164992', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.manager [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:48 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Deleted volume successfully. Apr 14 04:22:48 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5b88caf3-cf8f-48c4-82a4-11c457caaf2c tempest-VolumeQuotasAdminTestJSON-1237095179 None] Lock "cinder-68cab9b8-6018-4f68-9f68-31f4a7a2b76f-delete_volume" released by "delete_volume" :: held 4.191s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] volume v_c61f6e25-4530-44b6-8af8-e6eb35c044a0 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.quota [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Created reservations ['cd28bc55-fb7f-4b9d-9030-561c90d26d98', '8003367e-bdd0-471d-9845-3c535b1a064a', 'b35edcad-1079-44f2-8fe9-5a9a119399ed', 'a0ad2a87-7bdd-4462-ab9e-ff2e8b56ae9d'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=35,cinder:SELECT=52,cinder:DELETE=4,cinder:INSERT=9 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238246912', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.manager [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:49 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Deleted volume successfully. Apr 14 04:22:49 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e03abe02-d5e3-4f90-8676-36be10c510f4 tempest-VolumesListTestJSON-1671593894 None] Lock "cinder-c61f6e25-4530-44b6-8af8-e6eb35c044a0-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Flow 'volume_create_manager' (98add94c-556c-41f5-8b51-6fc1e9ecf873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96278504-0cc3-4a04-9d58-78cd8c0cceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96278504-0cc3-4a04-9d58-78cd8c0cceec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-567397729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4556fb9d-f2db-49ab-ba16-cff6900a5ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f45f01678f747268221c00f75924c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:52Z,use_quota=True,user_id='275086d3eec449678b6b5ba6f3f887b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923618fc-c5b3-415d-890b-015b04baed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923618fc-c5b3-415d-890b-015b04baed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec915776-fc1c-4e1e-9c8f-35ffc17e3d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec915776-fc1c-4e1e-9c8f-35ffc17e3d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'volume_name': 'volume-4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d45317-1cfe-4a66-9a4d-4257e8ca0d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d45317-1cfe-4a66-9a4d-4257e8ca0d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e90aaf-c6b4-4c98-afe3-1960ce7ab8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:52 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Volume 4556fb9d-f2db-49ab-ba16-cff6900a5ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'volume_size': 1} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] creating volume v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] create volume {'name': 'v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'is_clone': False, 'name': 'v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e90aaf-c6b4-4c98-afe3-1960ce7ab8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5665d3-709a-4cd2-afa8-8924d82f4265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:53 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Volume volume-4556fb9d-f2db-49ab-ba16-cff6900a5ec7 (4556fb9d-f2db-49ab-ba16-cff6900a5ec7): created successfully Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5665d3-709a-4cd2-afa8-8924d82f4265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Flow 'volume_create_manager' (98add94c-556c-41f5-8b51-6fc1e9ecf873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-75adc076-d988-4e23-851b-49625d66948e tempest-VolumesNegativeTest-1984420239 None] Created volume successfully. Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Acquiring lock "cinder-70317b0d-2515-45ac-825b-207626822497-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Lock "cinder-70317b0d-2515-45ac-825b-207626822497-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] remove_export for volume: 70317b0d-2515-45ac-825b-207626822497. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1673433759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=70317b0d-2515-45ac-825b-207626822497,launched_at=2023-04-14T04:19:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a60f60717b44f4ba904a949eabfe608',provider_auth='CHAP HkOfdlri ND2Pn4oiHQ5wIj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:46Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:53Z,updated_at=2023-04-14T04:22:53Z,use_quota=True,user_id='982f167333954612a51911fc8d6c1ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] detach volume v_70317b0d-2515-45ac-825b-207626822497 from target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns/v_70317b0d-2515-45ac-825b-207626822497'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497/luns/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] failed to remove resource iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 because of JDSS resource v_70317b0d-2515-45ac-825b-207626822497 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] delete target: iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] delete target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] failed to remove resource iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 because of JDSS resource iqn.2010-10.org.openstack:70317b0d-2515-45ac-825b-207626822497 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] deleating volume v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] get snapshots for volume v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] get volume v_70317b0d-2515-45ac-825b-207626822497 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_70317b0d-2515-45ac-825b-207626822497', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447395', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114934', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17168776723967627804', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '13d3240d44872563', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238164992', 'san:volume_id': '13d3240d44872563a51f91a95dd242dcd6916851', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87007', 'name': 'v_70317b0d-2515-45ac-825b-207626822497', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] delete volume:v_70317b0d-2515-45ac-825b-207626822497 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Flow 'volume_create_manager' (71094101-4708-4748-9c63-3f1b8ab072ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0bd310-f632-48ab-84ff-0ed95ea18693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0bd310-f632-48ab-84ff-0ed95ea18693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1296088561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4afbe199-73a3-421d-8519-c457a1d5765f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299fa281c2d044628f94f105db18873e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:22:55Z,use_quota=True,user_id='f31c5a53a3b342118de095e349207262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c0ee890-26e4-4f1b-91c6-4e858e62277f),volume_type_id=2c0ee890-26e4-4f1b-91c6-4e858e62277f)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f03dd9-15b1-4731-87c5-c28a96246410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f03dd9-15b1-4731-87c5-c28a96246410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5656dd-9e07-472b-a78a-52bd9a8920f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5656dd-9e07-472b-a78a-52bd9a8920f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4afbe199-73a3-421d-8519-c457a1d5765f', 'volume_name': 'volume-4afbe199-73a3-421d-8519-c457a1d5765f', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1fb16a-c960-486b-98a9-68dbe22150e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1fb16a-c960-486b-98a9-68dbe22150e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a46a81-15a5-486c-ad0a-3843ad3c745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Volume 4afbe199-73a3-421d-8519-c457a1d5765f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4afbe199-73a3-421d-8519-c457a1d5765f', 'volume_size': 1} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] creating volume v_4afbe199-73a3-421d-8519-c457a1d5765f. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] create volume {'name': 'v_4afbe199-73a3-421d-8519-c457a1d5765f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4afbe199-73a3-421d-8519-c457a1d5765f', 'is_clone': False, 'name': 'v_4afbe199-73a3-421d-8519-c457a1d5765f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a46a81-15a5-486c-ad0a-3843ad3c745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afbe199-73a3-421d-8519-c457a1d5765f', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e59b06b-d75d-4724-8813-79355137c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:22:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Volume volume-4afbe199-73a3-421d-8519-c457a1d5765f (4afbe199-73a3-421d-8519-c457a1d5765f): created successfully Apr 14 04:22:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e59b06b-d75d-4724-8813-79355137c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:22:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Flow 'volume_create_manager' (71094101-4708-4748-9c63-3f1b8ab072ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:22:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7003332f-4698-43e3-9c14-e0e75acc3163 tempest-VolumeTypesTest-922900542 None] Created volume successfully. Apr 14 04:22:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70317b0d-2515-45ac-825b-207626822497 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] volume v_70317b0d-2515-45ac-825b-207626822497 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:22:56 user cinder-volume[73393]: DEBUG cinder.quota [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Created reservations ['bf414d9a-41a4-4f4d-8e62-09b0c7fdd92f', '75b19216-13a6-4755-90b3-18b1f6e26275', '1ebb5052-e5db-4dc1-a8cf-2d039ae8860e', 'c65f8c77-89b1-4b0a-8c4f-d9d6777019e0'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:22:56 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=52,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238177280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.manager [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Deleted volume successfully. Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c05be178-0d26-429a-98db-a479abcfcd04 tempest-TestMinimumBasicScenario-1872250892 None] Lock "cinder-70317b0d-2515-45ac-825b-207626822497-delete_volume" released by "delete_volume" :: held 3.753s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238177280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.manager [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:22:58 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3427687c-c12e-4b40-988c-d510f6d761b5 tempest-VolumeTypesTest-922900542 None] Retype volume completed successfully. Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Acquiring lock "cinder-4afbe199-73a3-421d-8519-c457a1d5765f-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Lock "cinder-4afbe199-73a3-421d-8519-c457a1d5765f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] remove_export for volume: 4afbe199-73a3-421d-8519-c457a1d5765f. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1296088561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4afbe199-73a3-421d-8519-c457a1d5765f,launched_at=2023-04-14T04:22:56Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='299fa281c2d044628f94f105db18873e',provider_auth='CHAP qcpIaRUw LhRm4MDU7upIiZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:55Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:22:59Z,updated_at=2023-04-14T04:22:59Z,use_quota=True,user_id='f31c5a53a3b342118de095e349207262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8216a244-122f-4532-94ea-01e33d811112),volume_type_id=8216a244-122f-4532-94ea-01e33d811112) from target:iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] detach volume v_4afbe199-73a3-421d-8519-c457a1d5765f from target iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f/luns/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f/luns/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f/luns/v_4afbe199-73a3-421d-8519-c457a1d5765f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f/luns/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] failed to remove resource iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f because of JDSS resource v_4afbe199-73a3-421d-8519-c457a1d5765f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] delete target: iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] delete target iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] failed to remove resource iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f because of JDSS resource iqn.2010-10.org.openstack:4afbe199-73a3-421d-8519-c457a1d5765f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] deleating volume v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] get snapshots for volume v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] get volume v_4afbe199-73a3-421d-8519-c457a1d5765f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4afbe199-73a3-421d-8519-c457a1d5765f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447584', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115207', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6625979645432536459', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0738c49606ff4bb2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238177280', 'san:volume_id': '0738c49606ff4bb22dde09db9ffca5c30c88c35c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87504', 'name': 'v_4afbe199-73a3-421d-8519-c457a1d5765f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] delete volume:v_4afbe199-73a3-421d-8519-c457a1d5765f recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:22:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afbe199-73a3-421d-8519-c457a1d5765f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] volume v_4afbe199-73a3-421d-8519-c457a1d5765f deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:23:01 user cinder-volume[73393]: WARNING cinder.quota [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1147566985 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1147566985, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:23:01 user cinder-volume[73393]: WARNING cinder.quota [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1147566985 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1147566985, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:23:01 user cinder-volume[73393]: DEBUG cinder.quota [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Created reservations ['da796c62-cbdd-4e0e-b9d7-4b6da271789e', 'c6c29e86-16ee-454b-a012-b930cc2b1127', '7dbdddff-b30d-483e-96f4-a7509043be5a', '6cb9299f-16e3-4c35-bc0b-e3197bf745be'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238259200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.manager [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Deleted volume successfully. Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bc26aab1-e8cf-451b-875a-c8dafb0084a0 tempest-VolumeTypesTest-922900542 None] Lock "cinder-4afbe199-73a3-421d-8519-c457a1d5765f-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Acquiring lock "cinder-5e5988ce-8d0a-49a0-acc8-84f7d3917bd3-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-5e5988ce-8d0a-49a0-acc8-84f7d3917bd3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] remove_export for volume: 5e5988ce-8d0a-49a0-acc8-84f7d3917bd3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-314191079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e5988ce-8d0a-49a0-acc8-84f7d3917bd3,launched_at=2023-04-14T04:20:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth='CHAP WspLiGZN EBbSCWOmtGe1Rx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:00Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:23:03Z,updated_at=2023-04-14T04:23:03Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] detach volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 from target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/luns/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] failed to remove resource iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 because of JDSS resource v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] delete target: iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] delete target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] failed to remove resource iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 because of JDSS resource iqn.2010-10.org.openstack:5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] deleating volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] get snapshots for volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] get volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447409', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114959', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16706657600470234881', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b5a2c7dde4fad581', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238259200', 'san:volume_id': 'b5a2c7dde4fad581a9b65c9ba10e6bfcf5ce323e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87787', 'name': 'v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] delete volume:v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] volume v_5e5988ce-8d0a-49a0-acc8-84f7d3917bd3 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG cinder.quota [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Created reservations ['42293946-6632-4039-967c-9341bf862546', 'c48701ab-6d53-4e6a-b3b6-18241b95559d', 'f87a513e-c298-49a4-b693-5a12b810520f', 'faa255a9-9bf5-43cd-9bb3-f92fd127cc4e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Acquiring lock "cinder-40e8dfdd-c6e4-4f7f-a465-913fe79829ac-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-40e8dfdd-c6e4-4f7f-a465-913fe79829ac-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] remove_export for volume: 40e8dfdd-c6e4-4f7f-a465-913fe79829ac. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2144330636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=40e8dfdd-c6e4-4f7f-a465-913fe79829ac,launched_at=2023-04-14T04:19:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth='CHAP aEOFgACW 20SXuvWjktEKHl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:58Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:23:06Z,updated_at=2023-04-14T04:23:06Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] detach volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac from target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238341120', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.manager [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:06 user cinder-volume[73393]: INFO cinder.volume.manager [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Deleted volume successfully. Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cd11ef20-9930-40ec-b44f-eb3940188bd1 tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-5e5988ce-8d0a-49a0-acc8-84f7d3917bd3-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac/luns/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] failed to remove resource iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac because of JDSS resource v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] delete target: iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] delete target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] failed to remove resource iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac because of JDSS resource iqn.2010-10.org.openstack:40e8dfdd-c6e4-4f7f-a465-913fe79829ac DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] deleating volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] get snapshots for volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] get volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447407', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114954', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6260130609417544231', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7019a64fc4faca71', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238341120', 'san:volume_id': '7019a64fc4faca7146951381708e88af9fc043f4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87481', 'name': 'v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] delete volume:v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Flow 'volume_create_manager' (1700accf-8794-440f-9878-bc3545ff4d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3115c326-8966-4e86-88bc-d2c7754a6784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3115c326-8966-4e86-88bc-d2c7754a6784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1151542467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=46d817a1-c71d-459f-a154-6047b74030c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ed358a7c774119bc531bc71c20cdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:23:07Z,use_quota=True,user_id='4346d4776b0d4e3a8be6ac201da8bb66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d80391d-6f64-4bd4-a7f4-e0e12f7ae188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d80391d-6f64-4bd4-a7f4-e0e12f7ae188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3160eebc-78a9-4756-94ef-c0952d0fd8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3160eebc-78a9-4756-94ef-c0952d0fd8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d817a1-c71d-459f-a154-6047b74030c4', 'volume_name': 'volume-46d817a1-c71d-459f-a154-6047b74030c4', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cbb471-b05d-462b-b807-af0bdd07a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cbb471-b05d-462b-b807-af0bdd07a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc653060-d4d6-4378-808c-66093b1b55fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:07 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Volume 46d817a1-c71d-459f-a154-6047b74030c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d817a1-c71d-459f-a154-6047b74030c4', 'volume_size': 1} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] creating volume v_46d817a1-c71d-459f-a154-6047b74030c4. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] create volume {'name': 'v_46d817a1-c71d-459f-a154-6047b74030c4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_46d817a1-c71d-459f-a154-6047b74030c4', 'is_clone': False, 'name': 'v_46d817a1-c71d-459f-a154-6047b74030c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc653060-d4d6-4378-808c-66093b1b55fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d817a1-c71d-459f-a154-6047b74030c4', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa41a22b-b02c-43a7-9cac-769bd8e4ad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:08 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Volume volume-46d817a1-c71d-459f-a154-6047b74030c4 (46d817a1-c71d-459f-a154-6047b74030c4): created successfully Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa41a22b-b02c-43a7-9cac-769bd8e4ad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Flow 'volume_create_manager' (1700accf-8794-440f-9878-bc3545ff4d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1a5d1d13-1b20-4e93-b88e-499818baffd5 tempest-VolumesTransfersV357Test-1228960603 None] Created volume successfully. Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] volume v_40e8dfdd-c6e4-4f7f-a465-913fe79829ac deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.quota [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Created reservations ['9c6b3656-55a1-42f0-9289-2fcc703200d6', '7e514b89-2fb1-4db4-9f6c-c232b89de02b', '7d9b0b98-193d-4747-a065-ee71e1e2490f', '30a9c66c-a7cd-43f1-bc4e-a42969780ecf'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=61,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Acquiring lock "cinder-f2d01790-bd9f-4eff-aa4d-2248429aeb94-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-f2d01790-bd9f-4eff-aa4d-2248429aeb94-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] remove_export for volume: f2d01790-bd9f-4eff-aa4d-2248429aeb94. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2019879053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f2d01790-bd9f-4eff-aa4d-2248429aeb94,launched_at=2023-04-14T04:19:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3162a049880f4b85afda331443cf52f1',provider_auth='CHAP FdyQafHs 4ALeOqymcn0XtT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:19:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:23:09Z,updated_at=2023-04-14T04:23:09Z,use_quota=True,user_id='3537afcf5a3e47deb53acb34d00e0e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] detach volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 from target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94/luns/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] failed to remove resource iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 because of JDSS resource v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] delete target: iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] delete target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] failed to remove resource iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 because of JDSS resource iqn.2010-10.org.openstack:f2d01790-bd9f-4eff-aa4d-2248429aeb94 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] deleating volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] get snapshots for volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238353408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.manager [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:09 user cinder-volume[73393]: INFO cinder.volume.manager [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Deleted volume successfully. Apr 14 04:23:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cb7d7194-2dda-4370-a320-319cdf67dfa8 tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-40e8dfdd-c6e4-4f7f-a465-913fe79829ac-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] get volume v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447404', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '114945', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13982922437952156039', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10125312', 'logicalused': '26030080', 'compressratio': '2.59', 'rootcontext': 'none', 'default_scsi_id': '232cba263dfbb5b8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238353408', 'san:volume_id': '232cba263dfbb5b8eca9bcdd9df6ac69ede1892b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.68', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10125312', 'objsetid': '87771', 'name': 'v_f2d01790-bd9f-4eff-aa4d-2248429aeb94', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10125312', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] delete snapshot v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ede97be2-c0ca-4340-b6be-6f3c22be0e79 tempest-VolumesTransfersV357Test-482117763 None] Transfer volume completed successfully. Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Acquiring lock "cinder-46d817a1-c71d-459f-a154-6047b74030c4-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Lock "cinder-46d817a1-c71d-459f-a154-6047b74030c4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] remove_export for volume: 46d817a1-c71d-459f-a154-6047b74030c4. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1151542467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=46d817a1-c71d-459f-a154-6047b74030c4,launched_at=2023-04-14T04:23:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7371f303029644d2a9ac0d43f89bb3a6',provider_auth='CHAP OwnXRLES QW9wcxSmeIofJ5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:07Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:23:11Z,updated_at=2023-04-14T04:23:11Z,use_quota=True,user_id='ccbb3db97b1b4046bf8201aa18678e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] detach volume v_46d817a1-c71d-459f-a154-6047b74030c4 from target iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4/luns/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4/luns/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4/luns/v_46d817a1-c71d-459f-a154-6047b74030c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4/luns/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] failed to remove resource iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 because of JDSS resource v_46d817a1-c71d-459f-a154-6047b74030c4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] delete target: iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] delete target iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] failed to remove resource iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 because of JDSS resource iqn.2010-10.org.openstack:46d817a1-c71d-459f-a154-6047b74030c4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] deleating volume v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] get snapshots for volume v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] get volume v_46d817a1-c71d-459f-a154-6047b74030c4 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_46d817a1-c71d-459f-a154-6047b74030c4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447596', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115214', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12406841678606470824', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bed064e62d6740ac', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248564736', 'san:volume_id': 'bed064e62d6740acba36ecc1831bb0a3d2753286', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88731', 'name': 'v_46d817a1-c71d-459f-a154-6047b74030c4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] delete volume:v_46d817a1-c71d-459f-a154-6047b74030c4 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] snapshot v_f2d01790-bd9f-4eff-aa4d-2248429aeb94 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:23:11 user cinder-volume[73393]: DEBUG cinder.quota [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Created reservations ['a1deb3eb-28ee-4560-8fdb-2f87606d80df', '8a7908b8-eee3-48d2-877a-61b260b9d31c', 'e3d06d42-f796-4cd2-9e61-4cafa5312ae4', 'b1d2793a-bfa4-45d4-b126-6614d83abd38'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] terminate connection for 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:23:12 user cinder-volume[73393]: INFO cinder.volume.manager [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Terminate volume connection completed successfully. Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Deleting attachment f6c08d20-8171-4b4a-a116-07bc4dc24f0c. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] remove_export for volume: 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1879579168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5,launched_at=2023-04-14T04:20:36Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='15bb9ddec81e4f6cbceb6ce7dee9c3a1',provider_auth='CHAP SvtMEfzm bnqt15GdO3hyC8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:33Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:23:12Z,use_quota=True,user_id='676d80d3684045298d895555247174af',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] detach volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 from target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248564736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.manager [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Deleted volume successfully. Apr 14 04:23:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fa0fff39-6029-4074-936c-a473f64cdeab tempest-TaggedBootDevicesTest-914882220 None] Lock "cinder-f2d01790-bd9f-4eff-aa4d-2248429aeb94-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] delete target: iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] delete target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46d817a1-c71d-459f-a154-6047b74030c4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] volume v_46d817a1-c71d-459f-a154-6047b74030c4 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.quota [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Created reservations ['1454c446-9848-4a5a-9e86-06239559a534', '22b190c2-ec7b-4c7f-8565-6eb0d54dcc96', '13364832-b717-4e21-8dc0-fb7245a4f3fc', '1003ce5a-3355-480c-823e-f9679c9f61ce'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fce9499b-e331-4ce2-a88d-832c24a656d5 req-cab5c9aa-92d0-4478-ab9c-3b2845e90212 tempest-ServerStableDeviceRescueTest-1018370864 None] target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248646656', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.manager [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Deleted volume successfully. Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d9008ff1-6b62-4832-a9cc-587092fdd456 tempest-VolumesTransfersV357Test-1210105421 None] Lock "cinder-46d817a1-c71d-459f-a154-6047b74030c4-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Flow 'volume_create_manager' (3fbace8f-8fd3-440f-83f9-497d3fb56da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8398f15b-bf9a-40ec-aaee-3aec11ab9939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8398f15b-bf9a-40ec-aaee-3aec11ab9939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-992654887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0bb4c7ba-242e-4cfa-b32d-b2e480561ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ed358a7c774119bc531bc71c20cdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:23:15Z,use_quota=True,user_id='4346d4776b0d4e3a8be6ac201da8bb66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d387be-623d-457d-86c0-08e2e4d8e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d387be-623d-457d-86c0-08e2e4d8e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472e1431-e32f-47c3-be7d-0b278c3178f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472e1431-e32f-47c3-be7d-0b278c3178f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'volume_name': 'volume-0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca3ad54-528a-473a-892b-0cb9eb68a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca3ad54-528a-473a-892b-0cb9eb68a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e816929b-c619-4183-bf70-65a54ef151d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:14 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Volume 0bb4c7ba-242e-4cfa-b32d-b2e480561ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'volume_size': 1} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] creating volume v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] create volume {'name': 'v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'is_clone': False, 'name': 'v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e816929b-c619-4183-bf70-65a54ef151d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20183b66-23c9-4fdd-bf0a-552bbbe08729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:15 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Volume volume-0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 (0bb4c7ba-242e-4cfa-b32d-b2e480561ff8): created successfully Apr 14 04:23:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20183b66-23c9-4fdd-bf0a-552bbbe08729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Flow 'volume_create_manager' (3fbace8f-8fd3-440f-83f9-497d3fb56da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:15 user cinder-volume[73393]: INFO cinder.volume.manager [None req-28182f3a-7a5d-40f5-abbb-8e62a0d271f0 tempest-VolumesTransfersV357Test-1228960603 None] Created volume successfully. Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Acquiring lock "cinder-0bb4c7ba-242e-4cfa-b32d-b2e480561ff8-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Lock "cinder-0bb4c7ba-242e-4cfa-b32d-b2e480561ff8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:DELETE=1,cinder:UPDATE=33,cinder:INSERT=6 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] remove_export for volume: 0bb4c7ba-242e-4cfa-b32d-b2e480561ff8. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-992654887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0bb4c7ba-242e-4cfa-b32d-b2e480561ff8,launched_at=2023-04-14T04:23:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ed358a7c774119bc531bc71c20cdd7',provider_auth='CHAP jihUZyKw ukiCneQS1JBF2O',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:15Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:23:17Z,updated_at=2023-04-14T04:23:17Z,use_quota=True,user_id='4346d4776b0d4e3a8be6ac201da8bb66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] detach volume v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 from target iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8/luns/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8/luns/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8/luns/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8/luns/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] failed to remove resource iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 because of JDSS resource v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] delete target: iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] delete target iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] failed to remove resource iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 because of JDSS resource iqn.2010-10.org.openstack:0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] deleating volume v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] get snapshots for volume v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] get volume v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447604', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115221', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8953140694846799509', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '251d6da82c0a39f1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248552448', 'san:volume_id': '251d6da82c0a39f1e535b06ad64aa1ef62d0e16a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87522', 'name': 'v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] delete volume:v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] volume v_0bb4c7ba-242e-4cfa-b32d-b2e480561ff8 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:23:19 user cinder-volume[73393]: DEBUG cinder.quota [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Created reservations ['1da6186c-5b1e-4862-86f7-f173bd9f9600', 'ecb0f41e-3277-4dd7-8661-68a39fd4c501', 'cea97b4f-26a0-4d35-8d52-fe755b90b129', '288f4d8e-d14e-4a88-b206-034a7018862d'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248634368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:20 user cinder-volume[73393]: DEBUG cinder.manager [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:20 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Deleted volume successfully. Apr 14 04:23:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8f68eab5-e3b6-4a44-bf97-eb3c9b30b9bd tempest-VolumesTransfersV357Test-1210105421 None] Lock "cinder-0bb4c7ba-242e-4cfa-b32d-b2e480561ff8-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:23:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114248634368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Flow 'volume_create_manager' (df01986b-ccbb-4ed9-853f-4ba07c4cb017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898364e3-b8b5-44ab-9c0b-a831929052c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898364e3-b8b5-44ab-9c0b-a831929052c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1229431068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ab50360-e2bb-4171-8b58-365ee3bcab93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3c53f8b249c4bfda77ee9a1b76ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:23:32Z,use_quota=True,user_id='93d8204c0c04488ba94e6d53f05d0d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d99197-0655-4d80-91f0-9be65e141fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d99197-0655-4d80-91f0-9be65e141fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf7d7fd-da75-46c8-b9ee-d72b30d89164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf7d7fd-da75-46c8-b9ee-d72b30d89164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab50360-e2bb-4171-8b58-365ee3bcab93', 'volume_name': 'volume-0ab50360-e2bb-4171-8b58-365ee3bcab93', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f8448-b936-42f2-9b63-435b8d15c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f8448-b936-42f2-9b63-435b8d15c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26923275-12ae-4bad-b942-c9f6e2707f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:32 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Volume 0ab50360-e2bb-4171-8b58-365ee3bcab93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab50360-e2bb-4171-8b58-365ee3bcab93', 'volume_size': 1} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] creating volume v_0ab50360-e2bb-4171-8b58-365ee3bcab93. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] create volume {'name': 'v_0ab50360-e2bb-4171-8b58-365ee3bcab93', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0ab50360-e2bb-4171-8b58-365ee3bcab93', 'is_clone': False, 'name': 'v_0ab50360-e2bb-4171-8b58-365ee3bcab93'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26923275-12ae-4bad-b942-c9f6e2707f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab50360-e2bb-4171-8b58-365ee3bcab93', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2715c4a-535d-4e81-b35f-a68e3e61ce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:33 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Volume volume-0ab50360-e2bb-4171-8b58-365ee3bcab93 (0ab50360-e2bb-4171-8b58-365ee3bcab93): created successfully Apr 14 04:23:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2715c4a-535d-4e81-b35f-a68e3e61ce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Flow 'volume_create_manager' (df01986b-ccbb-4ed9-853f-4ba07c4cb017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:34 user cinder-volume[73393]: INFO cinder.volume.manager [None req-73b46e65-2895-475b-8f40-0cfa004e9b6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Created volume successfully. Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] terminate connection for 3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:23:34 user cinder-volume[73393]: INFO cinder.volume.manager [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Terminate volume connection completed successfully. Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Deleting attachment 5257d9f6-4ed2-4452-88cf-1cd5a4131e1f. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1183423330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3e0082ad-1ad0-4980-a066-6017f65fce9e,launched_at=2023-04-14T04:20:28Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP YjWqRKtu lfA29KzFXS4idg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:27Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:23:33Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] detach volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e from target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] create snapshot 29926452-f367-4845-93f1-a28f4f471343 for volume 0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:23:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] cloning v_0ab50360-e2bb-4171-8b58-365ee3bcab93 to s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:23:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] create snapshot s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:23:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c6ca001-9179-4ec1-86a8-84541ed41c44 req-92056cfa-c2ca-4f60-bd5e-3238e011d67d tempest-ServerActionsTestJSON-1048786641 None] target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:23:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_29926452-f367-4845-93f1-a28f4f471343'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] create volume s_29926452-f367-4845-93f1-a28f4f471343 from snapshot s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:23:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0ab50360-e2bb-4171-8b58-365ee3bcab93@s_29926452-f367-4845-93f1-a28f4f471343', 'is_clone': True, 'full_name': 'Pool-0/s_29926452-f367-4845-93f1-a28f4f471343', 'name': 's_29926452-f367-4845-93f1-a28f4f471343'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] volume s_29926452-f367-4845-93f1-a28f4f471343 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:23:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f300921c-e579-41db-895c-58de6a32dd55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Create snapshot completed successfully Apr 14 04:23:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Acquiring lock "cinder-29926452-f367-4845-93f1-a28f4f471343-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:23:38 user cinder-volume[73393]: DEBUG cinder.coordination [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Lock "cinder-29926452-f367-4845-93f1-a28f4f471343-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:23:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] deleating snapshot s_29926452-f367-4845-93f1-a28f4f471343. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:23:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] get snapshots for volume s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:23:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] get volume s_29926452-f367-4845-93f1-a28f4f471343 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0ab50360-e2bb-4171-8b58-365ee3bcab93@s_29926452-f367-4845-93f1-a28f4f471343', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_29926452-f367-4845-93f1-a28f4f471343', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447625', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115234', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14384182283371617697', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dff035058f0abe96', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248491008', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88581', 'name': 's_29926452-f367-4845-93f1-a28f4f471343', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] delete snapshot s_29926452-f367-4845-93f1-a28f4f471343 of volume v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots/s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots/s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots/s_29926452-f367-4845-93f1-a28f4f471343 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] snapshot s_29926452-f367-4845-93f1-a28f4f471343 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:23:40 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=46,cinder:UPDATE=32,cinder:DELETE=5,cinder:INSERT=6 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.quota [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Created reservations ['846e13e4-5b4a-4cb4-9f4e-b592523a9551', '107a74ce-e8b9-46f1-bfdb-e15567d41d1c', '99b740f8-ab53-4b9e-aff5-1c9560ce8029', '6416dedb-b076-4580-ba0d-e558855bc876'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:41 user cinder-volume[73393]: INFO cinder.volume.manager [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Delete snapshot completed successfully. Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-37447e91-60f1-4b52-8691-91d7f2d559a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Lock "cinder-29926452-f367-4845-93f1-a28f4f471343-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Acquiring lock "cinder-0ab50360-e2bb-4171-8b58-365ee3bcab93-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Lock "cinder-0ab50360-e2bb-4171-8b58-365ee3bcab93-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] remove_export for volume: 0ab50360-e2bb-4171-8b58-365ee3bcab93. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1229431068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ab50360-e2bb-4171-8b58-365ee3bcab93,launched_at=2023-04-14T04:23:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3c53f8b249c4bfda77ee9a1b76ac',provider_auth='CHAP svYyIBbJ pjuHGDFq6QcIPf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:32Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:23:42Z,updated_at=2023-04-14T04:23:42Z,use_quota=True,user_id='93d8204c0c04488ba94e6d53f05d0d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] detach volume v_0ab50360-e2bb-4171-8b58-365ee3bcab93 from target iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93/luns/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93/luns/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93/luns/v_0ab50360-e2bb-4171-8b58-365ee3bcab93'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93/luns/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] failed to remove resource iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 because of JDSS resource v_0ab50360-e2bb-4171-8b58-365ee3bcab93 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] delete target: iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] delete target iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] failed to remove resource iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 because of JDSS resource iqn.2010-10.org.openstack:0ab50360-e2bb-4171-8b58-365ee3bcab93 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] deleating volume v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] get snapshots for volume v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] get volume v_0ab50360-e2bb-4171-8b58-365ee3bcab93 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0ab50360-e2bb-4171-8b58-365ee3bcab93', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447622', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115228', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4800281450008388394', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '581fb30c56e2cd13', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248491008', 'san:volume_id': '581fb30c56e2cd136610502e42c8293afdce03c1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88749', 'name': 'v_0ab50360-e2bb-4171-8b58-365ee3bcab93', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] delete volume:v_0ab50360-e2bb-4171-8b58-365ee3bcab93 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ab50360-e2bb-4171-8b58-365ee3bcab93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] volume v_0ab50360-e2bb-4171-8b58-365ee3bcab93 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:23:44 user cinder-volume[73393]: DEBUG cinder.quota [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Created reservations ['08e9fc97-fdc7-4042-adbd-8025843030f7', 'd8b16f35-5505-494f-9c03-1e7b7ead47cb', 'c6db4d98-76d4-4d0d-892c-80509ec67e49', '37e62cd7-d97e-4397-80d1-7d65f07e9c74'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:23:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:23:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:23:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248572928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:23:45 user cinder-volume[73393]: DEBUG cinder.manager [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:23:45 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Deleted volume successfully. Apr 14 04:23:45 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0803e507-484b-4654-b98d-f9533d465d0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1533707707 None] Lock "cinder-0ab50360-e2bb-4171-8b58-365ee3bcab93-delete_volume" released by "delete_volume" :: held 3.710s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:23:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=55,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:23:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Flow 'volume_create_manager' (39f69067-c3f8-4430-9efb-8901e5a4e1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1464cb-414a-4154-9138-3c32721ec91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1464cb-414a-4154-9138-3c32721ec91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1206363140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=17a1c79d-cbfc-4ca0-bae7-b824490f3db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5c64bd69f649a4b5cd7d7f0350435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:23:54Z,use_quota=True,user_id='4a1e1fc5c60b48998d18980a40e18fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49bc6ca-94d6-40fb-b0bc-708d27682292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49bc6ca-94d6-40fb-b0bc-708d27682292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050cc2da-c575-4e55-9a7f-3dd8c2935cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050cc2da-c575-4e55-9a7f-3dd8c2935cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'volume_name': 'volume-17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ce1821-ed59-4896-888d-8b7a4692bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ce1821-ed59-4896-888d-8b7a4692bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2349723f-f34d-4d5c-847d-17b2a32b2a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Volume 17a1c79d-cbfc-4ca0-bae7-b824490f3db6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'volume_size': 1} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] creating volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] create volume {'name': 'v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'is_clone': False, 'name': 'v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2349723f-f34d-4d5c-847d-17b2a32b2a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f38c70-86f9-4292-8325-f42614c937f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:23:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Volume volume-17a1c79d-cbfc-4ca0-bae7-b824490f3db6 (17a1c79d-cbfc-4ca0-bae7-b824490f3db6): created successfully Apr 14 04:23:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f38c70-86f9-4292-8325-f42614c937f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:23:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Flow 'volume_create_manager' (39f69067-c3f8-4430-9efb-8901e5a4e1de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:23:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-05168a85-3a55-4e18-94f4-d4f37fc2ba6a tempest-VolumesSnapshotListTestJSON-16780808 None] Created volume successfully. Apr 14 04:23:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] create snapshot acbe6275-5f72-4d95-acb7-a7e560fdc9f2 for volume 17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:23:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] cloning v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 to s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:23:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] create snapshot s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:23:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_acbe6275-5f72-4d95-acb7-a7e560fdc9f2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] create volume s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 from snapshot s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:23:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6@s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2', 'is_clone': True, 'full_name': 'Pool-0/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2', 'name': 's_acbe6275-5f72-4d95-acb7-a7e560fdc9f2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:23:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:23:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] volume s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:23:58 user cinder-volume[73393]: INFO cinder.volume.manager [None req-af2561eb-a6ef-43b5-bd4d-84526317b861 tempest-VolumesSnapshotListTestJSON-16780808 None] Create snapshot completed successfully Apr 14 04:23:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] create snapshot 6c41d0f9-b237-4bf0-847c-8ac3063aeb19 for volume 17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:23:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] cloning v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 to s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:23:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] create snapshot s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:23:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:23:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_6c41d0f9-b237-4bf0-847c-8ac3063aeb19'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] create volume s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 from snapshot s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:24:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Flow 'volume_create_manager' (d821126f-0aeb-4123-bad6-709336ef8f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4308b8-e49d-4a02-bffd-208836ef2df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4308b8-e49d-4a02-bffd-208836ef2df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-830041783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edd9bf49-5c37-4c22-8cf8-beacd7d1aa81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae0fb4af555422a847620627dffeae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:24:01Z,use_quota=True,user_id='ea68fb139b004f748cf1bcfb8d675a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17a0f7c-870b-4ef0-b0f8-9e8ee94e5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17a0f7c-870b-4ef0-b0f8-9e8ee94e5739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d7620d-4414-438f-b04d-04de86a0b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d7620d-4414-438f-b04d-04de86a0b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'volume_name': 'volume-edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eacc1ee-f745-48e7-9e5a-d02c3ff25947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eacc1ee-f745-48e7-9e5a-d02c3ff25947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302a5d1e-a66c-4bab-96bf-64fb098cf3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:01 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Volume edd9bf49-5c37-4c22-8cf8-beacd7d1aa81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'volume_size': 1} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] creating volume v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] create volume {'name': 'v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6@s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19', 'is_clone': True, 'full_name': 'Pool-0/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19', 'name': 's_6c41d0f9-b237-4bf0-847c-8ac3063aeb19'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] volume s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:24:01 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ac83b0eb-557f-4537-99ca-8eb955a53d59 tempest-VolumesSnapshotListTestJSON-16780808 None] Create snapshot completed successfully Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Acquiring lock "cinder-3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Lock "cinder-3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] remove_export for volume: 3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1879579168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5,launched_at=2023-04-14T04:20:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bb9ddec81e4f6cbceb6ce7dee9c3a1',provider_auth='CHAP SvtMEfzm bnqt15GdO3hyC8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:33Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:24:02Z,updated_at=2023-04-14T04:24:02Z,use_quota=True,user_id='676d80d3684045298d895555247174af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] detach volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 from target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/luns/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] failed to remove resource iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 because of JDSS resource v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] delete target: iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] delete target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] failed to remove resource iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 because of JDSS resource iqn.2010-10.org.openstack:3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] deleating volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] get snapshots for volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'is_clone': False, 'name': 'v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302a5d1e-a66c-4bab-96bf-64fb098cf3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fa9528-f32e-4de8-9e6b-4169dafcc1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:02 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Volume volume-edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 (edd9bf49-5c37-4c22-8cf8-beacd7d1aa81): created successfully Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fa9528-f32e-4de8-9e6b-4169dafcc1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Flow 'volume_create_manager' (d821126f-0aeb-4123-bad6-709336ef8f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:24:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4c72126f-5726-488b-8ea5-0b63985be90f tempest-ServersNegativeTestJSON-406789078 None] Created volume successfully. Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] get volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447443', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114986', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8386309249125099443', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1f4da6155f843201', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248359936', 'san:volume_id': '1f4da6155f843201a10f30e85c4c036b1589b365', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87156', 'name': 'v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] delete volume:v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] create snapshot c203fede-1ee2-4eab-a302-8d1cd4b4cddc for volume 17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] cloning v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 to s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] create snapshot s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c203fede-1ee2-4eab-a302-8d1cd4b4cddc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] create volume s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc from snapshot s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:24:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] volume v_3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.quota [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Created reservations ['ae2a7b8e-7eb6-4069-abd3-3ade6f3efbb8', 'd944b6e2-22ef-4198-9e35-4350ca1efad9', '84fe3625-6935-4f20-88de-b79731e7a496', 'e58bbeca-8bad-4da9-a09c-6f4be2dbad47'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6@s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc', 'is_clone': True, 'full_name': 'Pool-0/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc', 'name': 's_c203fede-1ee2-4eab-a302-8d1cd4b4cddc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] volume s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:24:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9a3cbfff-10e9-4e44-b485-2b00d8857312 tempest-VolumesSnapshotListTestJSON-16780808 None] Create snapshot completed successfully Apr 14 04:24:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248417280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:24:05 user cinder-volume[73393]: DEBUG cinder.manager [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:24:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Deleted volume successfully. Apr 14 04:24:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4db04ff4-b4ed-421d-a4af-c14324d90aa0 tempest-ServerStableDeviceRescueTest-1018370864 None] Lock "cinder-3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Acquiring lock "cinder-c203fede-1ee2-4eab-a302-8d1cd4b4cddc-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-c203fede-1ee2-4eab-a302-8d1cd4b4cddc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] deleating snapshot s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:24:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] get snapshots for volume s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] get volume s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6@s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447652', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115268', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7711252496631266809', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '147457cc3cdc8983', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248429568', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88510', 'name': 's_c203fede-1ee2-4eab-a302-8d1cd4b4cddc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] delete snapshot s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc of volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] snapshot s_c203fede-1ee2-4eab-a302-8d1cd4b4cddc deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:24:09 user cinder-volume[73393]: DEBUG cinder.quota [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Created reservations ['b4489474-6fbf-4ad5-b58e-e149827db906', '087a2ebf-fa46-474f-aa80-dcc6ab73e6ce', 'e577b643-2e89-4ca6-aaef-ba34b19f140e', 'c81ad4e2-b395-43bb-b43e-371a17536412'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:09 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Delete snapshot completed successfully. Apr 14 04:24:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fdcbb0e3-696e-4c41-ac5c-898c5efd37a6 tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-c203fede-1ee2-4eab-a302-8d1cd4b4cddc-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Acquiring lock "cinder-6c41d0f9-b237-4bf0-847c-8ac3063aeb19-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-6c41d0f9-b237-4bf0-847c-8ac3063aeb19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] deleating snapshot s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] get snapshots for volume s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] get volume s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6@s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447649', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115257', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18049576986376725811', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c1ebd37fa8965e0e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248441856', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88484', 'name': 's_6c41d0f9-b237-4bf0-847c-8ac3063aeb19', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] delete snapshot s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 of volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] snapshot s_6c41d0f9-b237-4bf0-847c-8ac3063aeb19 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:24:12 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=32,cinder:SELECT=52,cinder:INSERT=7,cinder:DELETE=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:12 user cinder-volume[73393]: DEBUG cinder.quota [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Created reservations ['5a4080e6-25d9-48d0-b4d8-0893c4ae5f6e', 'a7bbe0a8-920e-4f65-beb2-a579d9ef4fae', '6525c44d-236c-41b0-8b15-ab5a0555a5d2', 'fd4ed570-3056-41c2-a7c8-c3a84dfd5efd'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:12 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Delete snapshot completed successfully. Apr 14 04:24:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2ed54fff-554a-4d83-9f1a-250c200a5fdd tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-6c41d0f9-b237-4bf0-847c-8ac3063aeb19-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Acquiring lock "cinder-acbe6275-5f72-4d95-acb7-a7e560fdc9f2-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-acbe6275-5f72-4d95-acb7-a7e560fdc9f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] deleating snapshot s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] get snapshots for volume s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] get volume s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6@s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447646', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115251', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6082318428147996764', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd6c46abea93835be', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248478720', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88471', 'name': 's_acbe6275-5f72-4d95-acb7-a7e560fdc9f2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] delete snapshot s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 of volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots/s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] snapshot s_acbe6275-5f72-4d95-acb7-a7e560fdc9f2 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:24:15 user cinder-volume[73393]: DEBUG cinder.quota [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Created reservations ['f767a6a9-922e-423b-b072-94b0e25b370f', '3bca358c-26cf-4124-bfcd-2d946e67ebf1', 'eb8fd872-6232-40ec-b003-112c42f46f29', '9091efc0-45c4-4ae2-8c9c-823271ce1fbe'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:15 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Delete snapshot completed successfully. Apr 14 04:24:15 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3fd07419-bee7-44fa-88b5-642945c7ebe9 tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-acbe6275-5f72-4d95-acb7-a7e560fdc9f2-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Acquiring lock "cinder-17a1c79d-cbfc-4ca0-bae7-b824490f3db6-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-17a1c79d-cbfc-4ca0-bae7-b824490f3db6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] remove_export for volume: 17a1c79d-cbfc-4ca0-bae7-b824490f3db6. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1206363140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=17a1c79d-cbfc-4ca0-bae7-b824490f3db6,launched_at=2023-04-14T04:23:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5c64bd69f649a4b5cd7d7f0350435d',provider_auth='CHAP GWVKPBpF Z5DXz4J2BKe1Sy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:23:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:24:16Z,updated_at=2023-04-14T04:24:16Z,use_quota=True,user_id='4a1e1fc5c60b48998d18980a40e18fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] detach volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 from target iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6/luns/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6/luns/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6/luns/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6/luns/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] failed to remove resource iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 because of JDSS resource v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] delete target: iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] delete target iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] failed to remove resource iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 because of JDSS resource iqn.2010-10.org.openstack:17a1c79d-cbfc-4ca0-bae7-b824490f3db6 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] deleating volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] get snapshots for volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Flow 'volume_create_manager' (5f1f4f48-88ad-40f3-9965-230203c3311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119fa4e-ce76-4d1f-b7dd-a5dd5a05bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119fa4e-ce76-4d1f-b7dd-a5dd5a05bec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:24:16Z,deleted=False,deleted_at=None,display_description='',display_name='3df97db3-fd6c-4be6-af32-7cde9dbcce75-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6e31b954-88d8-448b-bbb7-f19007a51866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5995b934b0546c0983387e46e3b3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:24:17Z,use_quota=True,user_id='6ec7103e06e643a6b9b2c908ba8d7b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be552d5-7205-4674-aa9b-904d4ebd94a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be552d5-7205-4674-aa9b-904d4ebd94a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166bd8bf-dd3d-45c2-91c0-529b56d67df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166bd8bf-dd3d-45c2-91c0-529b56d67df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e31b954-88d8-448b-bbb7-f19007a51866', 'volume_name': 'volume-6e31b954-88d8-448b-bbb7-f19007a51866', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67de246-75a8-4f19-b2df-e16f75f0882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67de246-75a8-4f19-b2df-e16f75f0882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb420a2-2195-4c37-9b44-3b9e01d6beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Volume 6e31b954-88d8-448b-bbb7-f19007a51866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e31b954-88d8-448b-bbb7-f19007a51866', 'volume_size': 1} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] creating volume v_6e31b954-88d8-448b-bbb7-f19007a51866. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create volume {'name': 'v_6e31b954-88d8-448b-bbb7-f19007a51866', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] get volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447643', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115245', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '981126941961641456', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2d9d0959293b0568', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248478720', 'san:volume_id': '2d9d0959293b0568e6a4fc485e08e94fc6d96b46', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86514', 'name': 'v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] delete volume:v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6e31b954-88d8-448b-bbb7-f19007a51866', 'is_clone': False, 'name': 'v_6e31b954-88d8-448b-bbb7-f19007a51866'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb420a2-2195-4c37-9b44-3b9e01d6beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e31b954-88d8-448b-bbb7-f19007a51866', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233a069f-a3d0-4006-9ad4-f27b1c41c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:24:17 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Volume volume-6e31b954-88d8-448b-bbb7-f19007a51866 (6e31b954-88d8-448b-bbb7-f19007a51866): created successfully Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233a069f-a3d0-4006-9ad4-f27b1c41c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:24:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Flow 'volume_create_manager' (5f1f4f48-88ad-40f3-9965-230203c3311b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:24:17 user cinder-volume[73393]: INFO cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-0e471da2-05aa-4dcf-ab43-92a9defbb176 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Created volume successfully. Apr 14 04:24:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] volume v_17a1c79d-cbfc-4ca0-bae7-b824490f3db6 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.quota [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Created reservations ['89ca241b-db86-459d-8fc3-4547acbc4336', 'a9da4bac-31e2-41ca-84b9-cbaa80dd3066', '22b1df31-17a8-4caa-b5f9-d02b2c9d7c3f', '9d444c40-d56b-4bde-a3a4-07e00500c4d7'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248478720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.manager [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:24:19 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Deleted volume successfully. Apr 14 04:24:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a07dbef8-1f4d-44cf-82d6-acd77e040a18 tempest-VolumesSnapshotListTestJSON-16780808 None] Lock "cinder-17a1c79d-cbfc-4ca0-bae7-b824490f3db6-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create export for volume: 6e31b954-88d8-448b-bbb7-f19007a51866. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] ensure volume 6e31b954-88d8-448b-bbb7-f19007a51866 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] check if targe iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create target and attach volume 6e31b954-88d8-448b-bbb7-f19007a51866 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create target iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] atach volume v_6e31b954-88d8-448b-bbb7-f19007a51866 to target iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114248478720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:24:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:24:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3466366334383665', 'lun': 0, 'mode': 'wt', 'name': 'v_6e31b954-88d8-448b-bbb7-f19007a51866', 'prod_id': 'Storage', 'scsi_id': '4f6c486e774c3a44'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] add credentails to target iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:24:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YCyASkTZ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] initialize_connection for 6e31b954-88d8-448b-bbb7-f19007a51866 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:24:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCyASkTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '2931a803-f7ab-4f6c-b752-edcd2987b0d0'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:24:26 user cinder-volume[73393]: INFO cinder.volume.manager [req-cd573453-2dee-4d84-8124-4274af07943e req-b2fa6da4-dde9-49eb-b0b9-3a463a6119d8 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] attachment_update completed successfully. Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] create export for volume: de74dbb1-1657-4193-9520-50cfa823199b. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] ensure volume de74dbb1-1657-4193-9520-50cfa823199b assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] check if targe iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] create target and attach volume de74dbb1-1657-4193-9520-50cfa823199b to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] create target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] atach volume v_de74dbb1-1657-4193-9520-50cfa823199b to target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:24:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3738643433306262', 'lun': 0, 'mode': 'wt', 'name': 'v_de74dbb1-1657-4193-9520-50cfa823199b', 'prod_id': 'Storage', 'scsi_id': '78d430bb11d6f89e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] add credentails to target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:24:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YuLEGNAR'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] initialize_connection for de74dbb1-1657-4193-9520-50cfa823199b 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:24:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuLEGNAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'eb2fea8e-c47a-458a-9fa5-f84c13b16e30'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:24:34 user cinder-volume[73393]: INFO cinder.volume.manager [req-defcc02b-34a3-45f3-911a-b8757e910851 req-5c05a70f-915a-44c2-9615-f17f56be8e17 tempest-VolumesSnapshotTestJSON-1226436274 None] attachment_update completed successfully. Apr 14 04:24:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot 36b40078-fcd2-417e-a24b-7920fd1c0094 for volume de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:24:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_de74dbb1-1657-4193-9520-50cfa823199b to s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:24:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:24:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_36b40078-fcd2-417e-a24b-7920fd1c0094'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_36b40078-fcd2-417e-a24b-7920fd1c0094 from snapshot s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:24:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b@s_36b40078-fcd2-417e-a24b-7920fd1c0094', 'is_clone': True, 'full_name': 'Pool-0/s_36b40078-fcd2-417e-a24b-7920fd1c0094', 'name': 's_36b40078-fcd2-417e-a24b-7920fd1c0094'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_36b40078-fcd2-417e-a24b-7920fd1c0094 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:24:39 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=63,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:39 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6723ae3c-b358-4b5d-b4f0-829821e02133 tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:24:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot 3fb193f2-7169-4650-ba42-9ca1fe0b500d for volume de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:24:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_de74dbb1-1657-4193-9520-50cfa823199b to s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:24:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:24:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_3fb193f2-7169-4650-ba42-9ca1fe0b500d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_3fb193f2-7169-4650-ba42-9ca1fe0b500d from snapshot s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:24:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b@s_3fb193f2-7169-4650-ba42-9ca1fe0b500d', 'is_clone': True, 'full_name': 'Pool-0/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d', 'name': 's_3fb193f2-7169-4650-ba42-9ca1fe0b500d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_3fb193f2-7169-4650-ba42-9ca1fe0b500d properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=59,cinder:INSERT=13,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-89609c41-7db9-4b16-b94c-c76ade89d07e tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot 897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 for volume de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_de74dbb1-1657-4193-9520-50cfa823199b to s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 from snapshot s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:24:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b@s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2', 'is_clone': True, 'full_name': 'Pool-0/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2', 'name': 's_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:24:45 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8331ddd4-b1e5-451b-89b5-4aadbbdd9b34 tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-36b40078-fcd2-417e-a24b-7920fd1c0094-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-36b40078-fcd2-417e-a24b-7920fd1c0094-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_36b40078-fcd2-417e-a24b-7920fd1c0094. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_36b40078-fcd2-417e-a24b-7920fd1c0094 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b@s_36b40078-fcd2-417e-a24b-7920fd1c0094', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_36b40078-fcd2-417e-a24b-7920fd1c0094', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447687', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115301', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '731353379560573197', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6d05212553f18815', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248404992', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87529', 'name': 's_36b40078-fcd2-417e-a24b-7920fd1c0094', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_36b40078-fcd2-417e-a24b-7920fd1c0094 of volume v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_36b40078-fcd2-417e-a24b-7920fd1c0094 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_36b40078-fcd2-417e-a24b-7920fd1c0094 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:24:48 user cinder-volume[73393]: DEBUG cinder.quota [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['c924e213-58a9-4c03-8704-6f47f028cd7d', '81da40a7-21a6-489e-8ec5-69182ecd10eb', '1f6281bb-e068-443f-8a34-79133a158766', '3b020c57-eaea-4448-bd54-04a78915130e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:48 user cinder-volume[73393]: INFO cinder.volume.manager [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:24:48 user cinder-volume[73393]: DEBUG cinder.coordination [None req-438a4f30-339e-4039-b79d-6dd41fe1d100 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-36b40078-fcd2-417e-a24b-7920fd1c0094-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.coordination [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-897f69b6-9c16-4d5d-b1f1-f38d791e3ae2-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.coordination [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-897f69b6-9c16-4d5d-b1f1-f38d791e3ae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b@s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447693', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115313', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7188553836409643631', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bda5b37ce0fe3e5d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248429568', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89088', 'name': 's_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 of volume v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_897f69b6-9c16-4d5d-b1f1-f38d791e3ae2 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:24:51 user cinder-volume[73393]: DEBUG cinder.quota [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['f4a254cb-c730-4342-b096-29a00066f937', 'eab6a158-1483-451a-bdcc-2afea3300109', '1366f797-fa22-44ad-b374-46a1aa3fc0cc', '0ba789b7-c974-4857-97de-603577f43862'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:51 user cinder-volume[73393]: INFO cinder.volume.manager [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:24:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-87c6b10c-a446-4e82-b155-c3de769f7afc tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-897f69b6-9c16-4d5d-b1f1-f38d791e3ae2-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-3fb193f2-7169-4650-ba42-9ca1fe0b500d-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-3fb193f2-7169-4650-ba42-9ca1fe0b500d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_3fb193f2-7169-4650-ba42-9ca1fe0b500d. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_3fb193f2-7169-4650-ba42-9ca1fe0b500d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b@s_3fb193f2-7169-4650-ba42-9ca1fe0b500d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447690', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115307', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17692535138767674374', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9479ea1b74a1d4b2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248441856', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87545', 'name': 's_3fb193f2-7169-4650-ba42-9ca1fe0b500d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_3fb193f2-7169-4650-ba42-9ca1fe0b500d of volume v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:24:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots/s_3fb193f2-7169-4650-ba42-9ca1fe0b500d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_3fb193f2-7169-4650-ba42-9ca1fe0b500d deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:24:54 user cinder-volume[73393]: DEBUG cinder.quota [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['f58fce41-5b8c-4826-85bb-e58ad94dfdb7', '7b2ec02b-9048-49df-80f4-5c8fb9c99f9f', 'b1fde367-e550-4bea-92f2-11386432c1c3', '0fb2b09d-c5a2-4a37-9a62-526d7d6e0dfa'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:24:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:24:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9b688f1f-ae18-4921-800b-b8b31cdf6281 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-3fb193f2-7169-4650-ba42-9ca1fe0b500d-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] terminate connection for de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:24:56 user cinder-volume[73393]: INFO cinder.volume.manager [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Terminate volume connection completed successfully. Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Deleting attachment eb2fea8e-c47a-458a-9fa5-f84c13b16e30. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: de74dbb1-1657-4193-9520-50cfa823199b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-476306892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=de74dbb1-1657-4193-9520-50cfa823199b,launched_at=2023-04-14T04:22:36Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP YuLEGNAR SOo1nQ6w7dVpgq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:31Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:24:56Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_de74dbb1-1657-4193-9520-50cfa823199b from target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:24:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:24:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:24:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:24:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:24:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e req-3f89177f-b17e-4bfb-8db4-edf921f964bc tempest-VolumesSnapshotTestJSON-1226436274 None] target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:25:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1479fbc0-95d3-44d4-9e7a-1e749cac2c4d tempest-GroupsV320Test-793764483 None] Group tempest-GroupsV320Test-Group-683631098: creating Apr 14 04:25:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1479fbc0-95d3-44d4-9e7a-1e749cac2c4d tempest-GroupsV320Test-793764483 None] Group tempest-GroupsV320Test-Group-683631098: created successfully Apr 14 04:25:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1479fbc0-95d3-44d4-9e7a-1e749cac2c4d tempest-GroupsV320Test-793764483 None] Create group completed successfully. Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Acquiring lock "cinder-edd9bf49-5c37-4c22-8cf8-beacd7d1aa81-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Lock "cinder-edd9bf49-5c37-4c22-8cf8-beacd7d1aa81-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] remove_export for volume: edd9bf49-5c37-4c22-8cf8-beacd7d1aa81. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-830041783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edd9bf49-5c37-4c22-8cf8-beacd7d1aa81,launched_at=2023-04-14T04:24:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae0fb4af555422a847620627dffeae8',provider_auth='CHAP QzgunXIW fua0vAocgIenjC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:24:01Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:25:04Z,updated_at=2023-04-14T04:25:04Z,use_quota=True,user_id='ea68fb139b004f748cf1bcfb8d675a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] detach volume v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 from target iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81/luns/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81/luns/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81/luns/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81/luns/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] failed to remove resource iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 because of JDSS resource v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] delete target: iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] delete target iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] failed to remove resource iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 because of JDSS resource iqn.2010-10.org.openstack:edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] deleating volume v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] get snapshots for volume v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=20,cinder:UPDATE=23,cinder:SELECT=54,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=19,cinder:SELECT=61,cinder:UPDATE=20 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.quota [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Created reservations ['373ceeaf-702f-41d8-90f5-d15b1b4939ff'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] get volume v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447650', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115260', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1264669741802297193', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c122e4bfcd3e8105', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248454144', 'san:volume_id': 'c122e4bfcd3e810565e72df6156ec8ad15cef3a4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88494', 'name': 'v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] delete volume:v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248454144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:05 user cinder-volume[73393]: DEBUG cinder.manager [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7cc23cfd-55a8-43fc-a9b8-f15da738e06b tempest-GroupsV320Test-793764483 None] Delete group completed successfully. Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] volume v_edd9bf49-5c37-4c22-8cf8-beacd7d1aa81 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.quota [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Created reservations ['391fbb9e-d0dc-47c6-b798-e740e4bc5ae6', 'c1fc1f68-20c9-4efc-bfea-145e0d60d52b', '25b58da3-5b8e-469c-be65-28bd321cd1b7', '5808661b-01c6-40a0-9ad3-85ec274e5d20'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Acquiring lock "cinder-0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Lock "cinder-0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248536064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.manager [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Deleted volume successfully. Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-18b1cceb-7f17-46b1-8463-2be51a6a14ee tempest-ServersNegativeTestJSON-406789078 None] Lock "cinder-edd9bf49-5c37-4c22-8cf8-beacd7d1aa81-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] remove_export for volume: 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819489892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec,launched_at=2023-04-14T04:22:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae0fb4af555422a847620627dffeae8',provider_auth='CHAP KyAsqieg jvGwXu8aTLQbfF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:58Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:25:07Z,updated_at=2023-04-14T04:25:07Z,use_quota=True,user_id='ea68fb139b004f748cf1bcfb8d675a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] detach volume v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec from target iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec/luns/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec/luns/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec/luns/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec/luns/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] failed to remove resource iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec because of JDSS resource v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] delete target: iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] delete target iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] failed to remove resource iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec because of JDSS resource iqn.2010-10.org.openstack:0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] deleating volume v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] get snapshots for volume v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] get volume v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447527', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115092', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1659211947318755977', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dcdab2502369f31e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248536064', 'san:volume_id': 'dcdab2502369f31e480a54720656fb66ccb15dd5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87024', 'name': 'v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] delete volume:v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] volume v_0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:25:09 user cinder-volume[73393]: DEBUG cinder.quota [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Created reservations ['4c732bd0-875a-40b7-8a92-c044f4c33813', 'd7be7e40-1b8d-450d-af55-76edcc6bfe20', 'd330eb41-36c9-46ad-ad95-bf40778b0605', '8a36cdf0-c9e1-46c2-b7f7-70b7ac7144c6'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248617984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.manager [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Deleted volume successfully. Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-08e933e4-7507-45ab-9b46-21d365f30656 tempest-ServersNegativeTestJSON-406789078 None] Lock "cinder-0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Flow 'volume_create_manager' (2c69deae-64ac-4339-b1c1-851ccefe843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0d5dc4-179b-49e8-9455-d0f4fe053086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0d5dc4-179b-49e8-9455-d0f4fe053086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-225061273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f1f897b5-53c0-48eb-8f33-acd77c1b576f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ae4051a5c749b5acb158059743dbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:10Z,use_quota=True,user_id='fedbdf68cb194c5dabe117eb88032f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482e02ce-ebb7-409c-bda1-e5c25f314530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482e02ce-ebb7-409c-bda1-e5c25f314530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef4002d-4fba-4c3f-84df-caef604b2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef4002d-4fba-4c3f-84df-caef604b2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'volume_name': 'volume-f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08f427c-f8ee-4e4c-9211-67880b954bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08f427c-f8ee-4e4c-9211-67880b954bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9624a2fc-6138-4d9a-8989-f9a61b779661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Volume f1f897b5-53c0-48eb-8f33-acd77c1b576f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Cloning f1f897b5-53c0-48eb-8f33-acd77c1b576f from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 25, 10, 748834)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 25, 10, 766270)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] create snapshot v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Flow 'volume_create_manager' (851c0367-6712-4f56-920c-2474b2f7fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f1589e-0df6-4255-b36b-0dd983c2ac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f1589e-0df6-4255-b36b-0dd983c2ac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1287411734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2ea04249-09da-471f-a8b5-89a901381329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33320dc2f2c14ecfa5abf6574029c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:11Z,use_quota=True,user_id='5234914aec8e443b8a38ac6b38729031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b35def-0a00-481f-b8a7-a2ed631711c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b35def-0a00-481f-b8a7-a2ed631711c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ddaa8b-5d10-4011-9e59-31a569f2f557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ddaa8b-5d10-4011-9e59-31a569f2f557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea04249-09da-471f-a8b5-89a901381329', 'volume_name': 'volume-2ea04249-09da-471f-a8b5-89a901381329', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53701b6c-c62a-4bd1-9e5c-0a24ac4ed4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53701b6c-c62a-4bd1-9e5c-0a24ac4ed4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66835611-8ef6-4269-b5f4-7a4560fc578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:10 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Volume 2ea04249-09da-471f-a8b5-89a901381329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea04249-09da-471f-a8b5-89a901381329', 'volume_size': 1} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] creating volume v_2ea04249-09da-471f-a8b5-89a901381329. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] create volume {'name': 'v_2ea04249-09da-471f-a8b5-89a901381329', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2ea04249-09da-471f-a8b5-89a901381329', 'is_clone': False, 'name': 'v_2ea04249-09da-471f-a8b5-89a901381329'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66835611-8ef6-4269-b5f4-7a4560fc578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea04249-09da-471f-a8b5-89a901381329', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140bacad-304e-4bff-8518-0b5ed3ea44da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:11 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Volume volume-2ea04249-09da-471f-a8b5-89a901381329 (2ea04249-09da-471f-a8b5-89a901381329): created successfully Apr 14 04:25:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140bacad-304e-4bff-8518-0b5ed3ea44da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Flow 'volume_create_manager' (851c0367-6712-4f56-920c-2474b2f7fd95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:11 user cinder-volume[73393]: INFO cinder.volume.manager [None req-db663390-564d-4353-acf2-8a4b31585397 tempest-ServerRescueNegativeTestJSON-508041341 None] Created volume successfully. Apr 14 04:25:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_f1f897b5-53c0-48eb-8f33-acd77c1b576f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] create volume v_f1f897b5-53c0-48eb-8f33-acd77c1b576f from snapshot v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'is_clone': True, 'full_name': 'Pool-0/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'name': 'v_f1f897b5-53c0-48eb-8f33-acd77c1b576f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] get volume v_f1f897b5-53c0-48eb-8f33-acd77c1b576f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447721', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115339', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '332477615243601494', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2b530a3e74fd5f10', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248486912', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88548', 'name': 'v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Marking volume f1f897b5-53c0-48eb-8f33-acd77c1b576f as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to f1f897b5-53c0-48eb-8f33-acd77c1b576f. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Creating volume glance metadata for volume f1f897b5-53c0-48eb-8f33-acd77c1b576f backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9624a2fc-6138-4d9a-8989-f9a61b779661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3334d215-78a7-4dc4-b31a-c0bc1d16065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Volume volume-f1f897b5-53c0-48eb-8f33-acd77c1b576f (f1f897b5-53c0-48eb-8f33-acd77c1b576f): created successfully Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3334d215-78a7-4dc4-b31a-c0bc1d16065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Flow 'volume_create_manager' (2c69deae-64ac-4339-b1c1-851ccefe843a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d01cd2b0-d6e4-40fa-9939-f645b441de64 tempest-VolumesExtendTest-518618570 None] Created volume successfully. Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c0aa4a1-218a-4945-b4fe-aee0bf426c37 tempest-VolumesExtendTest-518618570 None] Extend volume f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c0aa4a1-218a-4945-b4fe-aee0bf426c37 tempest-VolumesExtendTest-518618570 None] jdss extend volume v_f1f897b5-53c0-48eb-8f33-acd77c1b576f to 2147483648 {{(pid=73393) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c0aa4a1-218a-4945-b4fe-aee0bf426c37 tempest-VolumesExtendTest-518618570 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c0aa4a1-218a-4945-b4fe-aee0bf426c37 tempest-VolumesExtendTest-518618570 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c0aa4a1-218a-4945-b4fe-aee0bf426c37 tempest-VolumesExtendTest-518618570 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8c0aa4a1-218a-4945-b4fe-aee0bf426c37 tempest-VolumesExtendTest-518618570 None] Extend volume completed successfully. Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.coordination [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Acquiring lock "cinder-f1f897b5-53c0-48eb-8f33-acd77c1b576f-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.coordination [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Lock "cinder-f1f897b5-53c0-48eb-8f33-acd77c1b576f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] remove_export for volume: f1f897b5-53c0-48eb-8f33-acd77c1b576f. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-225061273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f1f897b5-53c0-48eb-8f33-acd77c1b576f,launched_at=2023-04-14T04:25:13Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='70ae4051a5c749b5acb158059743dbcb',provider_auth='CHAP MKoUaRyc CU2YFfc3BvtS07',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:10Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:25:15Z,updated_at=2023-04-14T04:25:15Z,use_quota=True,user_id='fedbdf68cb194c5dabe117eb88032f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] detach volume v_f1f897b5-53c0-48eb-8f33-acd77c1b576f from target iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f/luns/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f/luns/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f/luns/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f/luns/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] failed to remove resource iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f because of JDSS resource v_f1f897b5-53c0-48eb-8f33-acd77c1b576f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] delete target: iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] delete target iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] failed to remove resource iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f because of JDSS resource iqn.2010-10.org.openstack:f1f897b5-53c0-48eb-8f33-acd77c1b576f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] deleating volume v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] get snapshots for volume v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] get volume v_f1f897b5-53c0-48eb-8f33-acd77c1b576f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447721', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115339', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '332477615243601494', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2b530a3e74fd5f10', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248368128', 'san:volume_id': '2b530a3e74fd5f10d70b6c623b91c9ec8fb6d9cf', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88548', 'name': 'v_f1f897b5-53c0-48eb-8f33-acd77c1b576f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] delete snapshot v_f1f897b5-53c0-48eb-8f33-acd77c1b576f of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_f1f897b5-53c0-48eb-8f33-acd77c1b576f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] snapshot v_f1f897b5-53c0-48eb-8f33-acd77c1b576f deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=56,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG cinder.quota [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Created reservations ['c2aa9cb7-d06b-48f2-9966-6605c03452e5', '1d56a177-5e97-4095-ab9a-83ce96ab9eb5', 'e62dccd1-c707-4223-9d88-5689293a86c5', 'e49f0ba4-c42d-4b2e-931e-36ef7fbb0733'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=59,cinder:INSERT=13,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248511488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.manager [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Deleted volume successfully. Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.coordination [None req-59e207c0-63c6-4ec0-8b15-87b59c73a833 tempest-VolumesExtendTest-518618570 None] Lock "cinder-f1f897b5-53c0-48eb-8f33-acd77c1b576f-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Flow 'volume_create_manager' (7c0ef26f-05ef-4f75-9a80-26e07cd9b139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13059c53-6296-4e6c-b3b9-9c26ee81e2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13059c53-6296-4e6c-b3b9-9c26ee81e2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1712154788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8bc46c31-9fd4-4dd4-85c1-5b95a26416a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ae4051a5c749b5acb158059743dbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:19Z,use_quota=True,user_id='fedbdf68cb194c5dabe117eb88032f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b85c151-456b-4d11-b5ee-e1e318ac6839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b85c151-456b-4d11-b5ee-e1e318ac6839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eaeab9-4c85-4e7b-a02d-b23d0965a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eaeab9-4c85-4e7b-a02d-b23d0965a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'volume_name': 'volume-8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e85bbda-4f09-4b0a-ac80-cda1f8d3dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e85bbda-4f09-4b0a-ac80-cda1f8d3dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6e7e65-f3ca-482b-bbac-7600ffd01370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:18 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Volume 8bc46c31-9fd4-4dd4-85c1-5b95a26416a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'volume_size': 1} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] creating volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] create volume {'name': 'v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'is_clone': False, 'name': 'v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6e7e65-f3ca-482b-bbac-7600ffd01370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac87c78-4a59-4c5b-ae58-1ca7fa383f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:19 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Volume volume-8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 (8bc46c31-9fd4-4dd4-85c1-5b95a26416a2): created successfully Apr 14 04:25:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac87c78-4a59-4c5b-ae58-1ca7fa383f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Flow 'volume_create_manager' (7c0ef26f-05ef-4f75-9a80-26e07cd9b139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:19 user cinder-volume[73393]: INFO cinder.volume.manager [None req-27fdcd5d-6a85-475b-964f-df824a94f95a tempest-VolumesExtendTest-518618570 None] Created volume successfully. Apr 14 04:25:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] create snapshot 78ba76dd-fcc8-4375-b067-332978df7457 for volume 8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:25:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] cloning v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 to s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] create snapshot s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Flow 'volume_create_manager' (be90ff52-decc-4637-98b2-50bf4603e6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93393bf-6a7a-4340-bec3-8ba2ebe34694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93393bf-6a7a-4340-bec3-8ba2ebe34694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-817649851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80fa232a-9074-4ca9-a62c-306fc14a6f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d389bb78d2e40b9b07d2d3ecdb7566b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:21Z,use_quota=True,user_id='d2561bbc0c6d447da333ffdbb9fdc5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dc78b3-8646-467a-b74d-f37920910af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dc78b3-8646-467a-b74d-f37920910af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e56ceaa-db5c-4c3f-85ea-a78636926af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e56ceaa-db5c-4c3f-85ea-a78636926af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fa232a-9074-4ca9-a62c-306fc14a6f35', 'volume_name': 'volume-80fa232a-9074-4ca9-a62c-306fc14a6f35', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3bcb6d-6b7f-4abc-a993-a3426bc8a2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3bcb6d-6b7f-4abc-a993-a3426bc8a2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61f8979-32a0-4ced-88f1-3b8a17bc0ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:21 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Volume 80fa232a-9074-4ca9-a62c-306fc14a6f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fa232a-9074-4ca9-a62c-306fc14a6f35', 'volume_size': 1} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] creating volume v_80fa232a-9074-4ca9-a62c-306fc14a6f35. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] create volume {'name': 'v_80fa232a-9074-4ca9-a62c-306fc14a6f35', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_80fa232a-9074-4ca9-a62c-306fc14a6f35', 'is_clone': False, 'name': 'v_80fa232a-9074-4ca9-a62c-306fc14a6f35'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61f8979-32a0-4ced-88f1-3b8a17bc0ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fa232a-9074-4ca9-a62c-306fc14a6f35', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21c501-efbe-4077-b6fd-baf7c0e9996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:22 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Volume volume-80fa232a-9074-4ca9-a62c-306fc14a6f35 (80fa232a-9074-4ca9-a62c-306fc14a6f35): created successfully Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21c501-efbe-4077-b6fd-baf7c0e9996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Flow 'volume_create_manager' (be90ff52-decc-4637-98b2-50bf4603e6a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:22 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b71168c2-deb4-4e38-9a90-7b9b1a80a15f tempest-VolumesAdminNegativeTest-618964915 None] Created volume successfully. Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_78ba76dd-fcc8-4375-b067-332978df7457'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] create volume s_78ba76dd-fcc8-4375-b067-332978df7457 from snapshot s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Acquiring lock "cinder-80fa232a-9074-4ca9-a62c-306fc14a6f35-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Lock "cinder-80fa232a-9074-4ca9-a62c-306fc14a6f35-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] remove_export for volume: 80fa232a-9074-4ca9-a62c-306fc14a6f35. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-817649851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80fa232a-9074-4ca9-a62c-306fc14a6f35,launched_at=2023-04-14T04:25:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d389bb78d2e40b9b07d2d3ecdb7566b',provider_auth='CHAP UWPJIMwd fZm875GLNX6R2a',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:21Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:25:22Z,updated_at=2023-04-14T04:25:22Z,use_quota=True,user_id='d2561bbc0c6d447da333ffdbb9fdc5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] detach volume v_80fa232a-9074-4ca9-a62c-306fc14a6f35 from target iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35/luns/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35/luns/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35/luns/v_80fa232a-9074-4ca9-a62c-306fc14a6f35'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35/luns/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] failed to remove resource iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 because of JDSS resource v_80fa232a-9074-4ca9-a62c-306fc14a6f35 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] delete target: iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] delete target iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] failed to remove resource iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 because of JDSS resource iqn.2010-10.org.openstack:80fa232a-9074-4ca9-a62c-306fc14a6f35 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] deleating volume v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] get snapshots for volume v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] get volume v_80fa232a-9074-4ca9-a62c-306fc14a6f35 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_80fa232a-9074-4ca9-a62c-306fc14a6f35', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447730', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115354', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7484977059155063688', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd2f928031465c903', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248310784', 'san:volume_id': 'd2f928031465c9036a334c01b5d740ade8aa19e2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88350', 'name': 'v_80fa232a-9074-4ca9-a62c-306fc14a6f35', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] delete volume:v_80fa232a-9074-4ca9-a62c-306fc14a6f35 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2@s_78ba76dd-fcc8-4375-b067-332978df7457', 'is_clone': True, 'full_name': 'Pool-0/s_78ba76dd-fcc8-4375-b067-332978df7457', 'name': 's_78ba76dd-fcc8-4375-b067-332978df7457'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] volume s_78ba76dd-fcc8-4375-b067-332978df7457 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:25:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f3a6ed8a-1c63-4e14-9870-3ac14f5af351 tempest-VolumesExtendTest-518618570 None] Create snapshot completed successfully Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Flow 'volume_create_manager' (2f42ae4e-f26e-4636-8070-77041adf3df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629c1460-42c0-454c-b131-e39ffce0dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629c1460-42c0-454c-b131-e39ffce0dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1226443700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9cdf2c58-c295-483e-b766-13e01129ede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:24Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1ca9c7-a519-4f4b-a1b7-147ba55d5809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1ca9c7-a519-4f4b-a1b7-147ba55d5809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f5611f-135a-4f3f-94c8-45905c172d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f5611f-135a-4f3f-94c8-45905c172d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cdf2c58-c295-483e-b766-13e01129ede2', 'volume_name': 'volume-9cdf2c58-c295-483e-b766-13e01129ede2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6c6754-09d3-4da0-a624-1d3d70660cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6c6754-09d3-4da0-a624-1d3d70660cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc98f66-310a-4e6c-9a9b-87c7465cee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:23 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Volume 9cdf2c58-c295-483e-b766-13e01129ede2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cdf2c58-c295-483e-b766-13e01129ede2', 'volume_size': 1} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] creating volume v_9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] create volume {'name': 'v_9cdf2c58-c295-483e-b766-13e01129ede2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6960ba0b-586f-4fc8-9830-0c3fba52794b tempest-VolumesExtendTest-518618570 None] Extend volume 8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6960ba0b-586f-4fc8-9830-0c3fba52794b tempest-VolumesExtendTest-518618570 None] jdss extend volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 to 2147483648 {{(pid=73393) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6960ba0b-586f-4fc8-9830-0c3fba52794b tempest-VolumesExtendTest-518618570 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6960ba0b-586f-4fc8-9830-0c3fba52794b tempest-VolumesExtendTest-518618570 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6960ba0b-586f-4fc8-9830-0c3fba52794b tempest-VolumesExtendTest-518618570 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6960ba0b-586f-4fc8-9830-0c3fba52794b tempest-VolumesExtendTest-518618570 None] Extend volume completed successfully. Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9cdf2c58-c295-483e-b766-13e01129ede2', 'is_clone': False, 'name': 'v_9cdf2c58-c295-483e-b766-13e01129ede2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc98f66-310a-4e6c-9a9b-87c7465cee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cdf2c58-c295-483e-b766-13e01129ede2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d97696-bfa2-4ea3-b3a4-c52fe13cc56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:24 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Volume volume-9cdf2c58-c295-483e-b766-13e01129ede2 (9cdf2c58-c295-483e-b766-13e01129ede2): created successfully Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d97696-bfa2-4ea3-b3a4-c52fe13cc56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Flow 'volume_create_manager' (2f42ae4e-f26e-4636-8070-77041adf3df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-92392256-1e34-4e86-800d-8909eaf9cfe1 tempest-ServerActionsTestJSON-1048786641 None] Created volume successfully. Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80fa232a-9074-4ca9-a62c-306fc14a6f35 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] volume v_80fa232a-9074-4ca9-a62c-306fc14a6f35 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Acquiring lock "cinder-78ba76dd-fcc8-4375-b067-332978df7457-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114248241152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.quota [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Created reservations ['f63bf0bb-4fe5-40af-8931-72c88a512d64', '6720d565-f4b7-4945-826a-5273aeeb9ae4', '16990e71-6d0f-4e59-b01d-da6e1bf646b0', '75204d03-6e43-4146-b06e-a79b1c3db9cb'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Lock "cinder-78ba76dd-fcc8-4375-b067-332978df7457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] deleating snapshot s_78ba76dd-fcc8-4375-b067-332978df7457. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] get snapshots for volume s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] get volume s_78ba76dd-fcc8-4375-b067-332978df7457 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2@s_78ba76dd-fcc8-4375-b067-332978df7457', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_78ba76dd-fcc8-4375-b067-332978df7457', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447731', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115359', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16035596968583409841', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ad6a84571e6ee166', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248241152', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89345', 'name': 's_78ba76dd-fcc8-4375-b067-332978df7457', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] delete snapshot s_78ba76dd-fcc8-4375-b067-332978df7457 of volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots/s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots/s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248241152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.manager [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:26 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Deleted volume successfully. Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ac13fc15-7aab-4c2c-8e00-ddace6429199 tempest-VolumesAdminNegativeTest-618964915 None] Lock "cinder-80fa232a-9074-4ca9-a62c-306fc14a6f35-delete_volume" released by "delete_volume" :: held 4.077s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] create export for volume: 9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] ensure volume 9cdf2c58-c295-483e-b766-13e01129ede2 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] check if targe iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] create target and attach volume 9cdf2c58-c295-483e-b766-13e01129ede2 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] create target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots/s_78ba76dd-fcc8-4375-b067-332978df7457 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] snapshot s_78ba76dd-fcc8-4375-b067-332978df7457 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:25:27 user cinder-volume[73393]: DEBUG cinder.quota [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Created reservations ['e94bcc27-14ef-4904-a708-725378144d02', '3665ef49-78f6-4fd1-96e0-4f5d57a1c50e', '4d331971-dccb-4fec-b517-8a525afc81c3', '93a0f2c4-c383-43d8-b778-91e382f9f9f9'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:27 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Delete snapshot completed successfully. Apr 14 04:25:27 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c3c3a057-b4a3-413a-9374-41325c726552 tempest-VolumesExtendTest-518618570 None] Lock "cinder-78ba76dd-fcc8-4375-b067-332978df7457-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Acquiring lock "cinder-8bc46c31-9fd4-4dd4-85c1-5b95a26416a2-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Lock "cinder-8bc46c31-9fd4-4dd4-85c1-5b95a26416a2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] remove_export for volume: 8bc46c31-9fd4-4dd4-85c1-5b95a26416a2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1712154788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8bc46c31-9fd4-4dd4-85c1-5b95a26416a2,launched_at=2023-04-14T04:25:20Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='70ae4051a5c749b5acb158059743dbcb',provider_auth='CHAP AuhLobzk bIdwvfnSJXuTCD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:19Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:25:29Z,updated_at=2023-04-14T04:25:29Z,use_quota=True,user_id='fedbdf68cb194c5dabe117eb88032f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] detach volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 from target iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/luns/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/luns/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/luns/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/luns/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] failed to remove resource iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 because of JDSS resource v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] delete target: iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] delete target iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] failed to remove resource iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 because of JDSS resource iqn.2010-10.org.openstack:8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] deleating volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] get snapshots for volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] get volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447727', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115349', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17645207489994567164', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9d17822463c04afe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248323072', 'san:volume_id': '9d17822463c04afe5a2ba4374fd303abf9184682', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88569', 'name': 'v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] delete volume:v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] atach volume v_9cdf2c58-c295-483e-b766-13e01129ede2 to target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] volume v_8bc46c31-9fd4-4dd4-85c1-5b95a26416a2 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:25:30 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=5,cinder:SELECT=57,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:30 user cinder-volume[73393]: DEBUG cinder.quota [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Created reservations ['424e6613-7a40-486b-8dfc-ae3f28256e5a', '2e445b40-aceb-4e36-adc2-16e0c2a62a50', '1d83b3e7-8930-40e5-9aed-e22099bfc301', '7eccd63c-11c6-470e-80d9-7f4a7fea9c7c'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=8 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3661646666666433', 'lun': 0, 'mode': 'wt', 'name': 'v_9cdf2c58-c295-483e-b766-13e01129ede2', 'prod_id': 'Storage', 'scsi_id': '6adfffd359b42273'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] add credentails to target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'name': 'MjAZDWGc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] initialize_connection for 9cdf2c58-c295-483e-b766-13e01129ede2 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MjAZDWGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '01070649-9cf2-47ee-8a10-1fc0171f4573'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:25:31 user cinder-volume[73393]: INFO cinder.volume.manager [req-e14ca792-7652-4305-8e06-f9fe36de7f49 req-664f0d5b-3725-460f-91b8-bb0df328d618 tempest-ServerActionsTestJSON-1048786641 None] attachment_update completed successfully. Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248417280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.manager [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Deleted volume successfully. Apr 14 04:25:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3ed58c56-fd2a-454f-bf57-5b339db4f561 tempest-VolumesExtendTest-518618570 None] Lock "cinder-8bc46c31-9fd4-4dd4-85c1-5b95a26416a2-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (bfdad960-c256-49cd-9c7d-c35430204464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ade2272-761a-4e66-93b1-92c765ec7e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ade2272-761a-4e66-93b1-92c765ec7e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2031203237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8ee7c552-e40e-4341-992f-722c82128913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:35Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5b8c61-b707-48b8-b3a3-e437fd9b2549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5b8c61-b707-48b8-b3a3-e437fd9b2549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9dbbaec-4ac6-45e6-9129-2b9a9e638ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9dbbaec-4ac6-45e6-9129-2b9a9e638ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee7c552-e40e-4341-992f-722c82128913', 'volume_name': 'volume-8ee7c552-e40e-4341-992f-722c82128913', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336d2a06-c2f4-4f1d-ae31-ed05097f4ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336d2a06-c2f4-4f1d-ae31-ed05097f4ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a901e7e-16b3-45d2-b3b2-6b16273cac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Volume 8ee7c552-e40e-4341-992f-722c82128913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee7c552-e40e-4341-992f-722c82128913', 'volume_size': 1} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] creating volume v_8ee7c552-e40e-4341-992f-722c82128913. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] create volume {'name': 'v_8ee7c552-e40e-4341-992f-722c82128913', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913', 'is_clone': False, 'name': 'v_8ee7c552-e40e-4341-992f-722c82128913'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a901e7e-16b3-45d2-b3b2-6b16273cac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee7c552-e40e-4341-992f-722c82128913', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541d72d8-1b89-4ee9-a4b6-ac613a796e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:36 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Volume volume-8ee7c552-e40e-4341-992f-722c82128913 (8ee7c552-e40e-4341-992f-722c82128913): created successfully Apr 14 04:25:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541d72d8-1b89-4ee9-a4b6-ac613a796e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (bfdad960-c256-49cd-9c7d-c35430204464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a5037aa9-3add-459a-a78a-2ef941e1b5c0 tempest-SnapshotDataIntegrityTests-502963555 None] Created volume successfully. Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] create export for volume: 8ee7c552-e40e-4341-992f-722c82128913. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] ensure volume 8ee7c552-e40e-4341-992f-722c82128913 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] check if targe iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] create target and attach volume 8ee7c552-e40e-4341-992f-722c82128913 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] create target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] terminate connection for 9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:25:40 user cinder-volume[73393]: INFO cinder.volume.manager [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Terminate volume connection completed successfully. Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Deleting attachment 01070649-9cf2-47ee-8a10-1fc0171f4573. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1226443700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9cdf2c58-c295-483e-b766-13e01129ede2,launched_at=2023-04-14T04:25:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP MjAZDWGc KyeNwxZHQq4i1a',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:24Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:25:34Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] detach volume v_9cdf2c58-c295-483e-b766-13e01129ede2 from target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-d5964961-b18a-4e3a-ba71-9df538ace08f tempest-ServerActionsTestJSON-1048786641 None] target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Flow 'volume_create_manager' (9dbdce51-bfc7-4024-8549-403ebc432740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9024c69-8b42-42d0-aed1-743516f8c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9024c69-8b42-42d0-aed1-743516f8c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1471656916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8f57c49-602f-450f-8b9e-69f1f0255cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a60f60717b44f4ba904a949eabfe608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:42Z,use_quota=True,user_id='982f167333954612a51911fc8d6c1ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac7d25a-1768-49b5-89b4-73671bbbbd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac7d25a-1768-49b5-89b4-73671bbbbd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6698b17b-d8ff-4e9d-8260-ec06c207bf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6698b17b-d8ff-4e9d-8260-ec06c207bf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f57c49-602f-450f-8b9e-69f1f0255cee', 'volume_name': 'volume-d8f57c49-602f-450f-8b9e-69f1f0255cee', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f58ed3a-e277-4a6a-a7ea-a37be134f9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f58ed3a-e277-4a6a-a7ea-a37be134f9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0356948e-360d-4914-9968-982a172da4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Volume d8f57c49-602f-450f-8b9e-69f1f0255cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f57c49-602f-450f-8b9e-69f1f0255cee', 'volume_size': 1} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] creating volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] create volume {'name': 'v_d8f57c49-602f-450f-8b9e-69f1f0255cee', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.coordination [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Acquiring lock "cinder-4556fb9d-f2db-49ab-ba16-cff6900a5ec7-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.coordination [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Lock "cinder-4556fb9d-f2db-49ab-ba16-cff6900a5ec7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] remove_export for volume: 4556fb9d-f2db-49ab-ba16-cff6900a5ec7. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-567397729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4556fb9d-f2db-49ab-ba16-cff6900a5ec7,launched_at=2023-04-14T04:22:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f45f01678f747268221c00f75924c69',provider_auth='CHAP MxDAcbwy jQEMeBcOUYrpTw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:52Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:25:42Z,updated_at=2023-04-14T04:25:42Z,use_quota=True,user_id='275086d3eec449678b6b5ba6f3f887b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] detach volume v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 from target iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7/luns/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7/luns/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7/luns/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7/luns/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] failed to remove resource iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 because of JDSS resource v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] delete target: iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] delete target iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] failed to remove resource iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 because of JDSS resource iqn.2010-10.org.openstack:4556fb9d-f2db-49ab-ba16-cff6900a5ec7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] deleating volume v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] get snapshots for volume v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] create export for volume: 9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] ensure volume 9cdf2c58-c295-483e-b766-13e01129ede2 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] check if targe iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] create target and attach volume 9cdf2c58-c295-483e-b766-13e01129ede2 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] create target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] get volume v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447581', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115202', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3844149383771057581', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3ed350e66ce4aa05', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248228864', 'san:volume_id': '3ed350e66ce4aa0502dda869c600f94314fc6e81', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88724', 'name': 'v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] delete volume:v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] atach volume v_8ee7c552-e40e-4341-992f-722c82128913 to target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d8f57c49-602f-450f-8b9e-69f1f0255cee', 'is_clone': False, 'name': 'v_d8f57c49-602f-450f-8b9e-69f1f0255cee'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0356948e-360d-4914-9968-982a172da4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f57c49-602f-450f-8b9e-69f1f0255cee', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a036ea9f-15f9-4b8a-bf60-7485a1329954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:43 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Volume volume-d8f57c49-602f-450f-8b9e-69f1f0255cee (d8f57c49-602f-450f-8b9e-69f1f0255cee): created successfully Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a036ea9f-15f9-4b8a-bf60-7485a1329954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Flow 'volume_create_manager' (9dbdce51-bfc7-4024-8549-403ebc432740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:43 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c0a3d125-0579-4f27-9fd5-cac3785841f8 tempest-TestMinimumBasicScenario-1872250892 None] Created volume successfully. Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3539623166303836', 'lun': 0, 'mode': 'wt', 'name': 'v_8ee7c552-e40e-4341-992f-722c82128913', 'prod_id': 'Storage', 'scsi_id': '59b1f086db0630e7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] add credentails to target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] volume v_4556fb9d-f2db-49ab-ba16-cff6900a5ec7 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'name': 'lSBjntEJ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] initialize_connection for 8ee7c552-e40e-4341-992f-722c82128913 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSBjntEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'cd50f445-165e-4fa4-94e8-183e38b93c10'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:25:44 user cinder-volume[73393]: DEBUG cinder.quota [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Created reservations ['1f03d989-a870-4259-a900-2ce9f8a4d7d2', 'cbe73edb-53df-4628-bcf3-ce28e3fe296a', '45a24f42-75a0-444e-8107-ff8086ec9cd8', '6014e29b-c586-4652-8da2-d7442a4cfa20'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:45 user cinder-volume[73393]: INFO cinder.volume.manager [req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c req-bc4dd3c9-5540-4187-94b3-6c76e30b9e51 tempest-SnapshotDataIntegrityTests-502963555 None] attachment_update completed successfully. Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] create export for volume: d8f57c49-602f-450f-8b9e-69f1f0255cee. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] ensure volume d8f57c49-602f-450f-8b9e-69f1f0255cee assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] check if targe iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] create target and attach volume d8f57c49-602f-450f-8b9e-69f1f0255cee to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] create target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248310784', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.manager [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] atach volume v_9cdf2c58-c295-483e-b766-13e01129ede2 to target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:45 user cinder-volume[73393]: INFO cinder.volume.manager [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Deleted volume successfully. Apr 14 04:25:45 user cinder-volume[73393]: DEBUG cinder.coordination [None req-baeba937-41f1-43c8-84a8-46d759ff9259 tempest-VolumesNegativeTest-1984420239 None] Lock "cinder-4556fb9d-f2db-49ab-ba16-cff6900a5ec7-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-de74dbb1-1657-4193-9520-50cfa823199b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-de74dbb1-1657-4193-9520-50cfa823199b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: de74dbb1-1657-4193-9520-50cfa823199b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-476306892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=de74dbb1-1657-4193-9520-50cfa823199b,launched_at=2023-04-14T04:22:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP YuLEGNAR SOo1nQ6w7dVpgq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:31Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:25:47Z,updated_at=2023-04-14T04:25:47Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_de74dbb1-1657-4193-9520-50cfa823199b from target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns/v_de74dbb1-1657-4193-9520-50cfa823199b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b/luns/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b because of JDSS resource v_de74dbb1-1657-4193-9520-50cfa823199b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b because of JDSS resource iqn.2010-10.org.openstack:de74dbb1-1657-4193-9520-50cfa823199b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating volume v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_de74dbb1-1657-4193-9520-50cfa823199b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_de74dbb1-1657-4193-9520-50cfa823199b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_de74dbb1-1657-4193-9520-50cfa823199b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447563', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115185', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5013150986778660738', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '78d430bb11d6f89e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114248310784', 'san:volume_id': '78d430bb11d6f89ef30a6dd9e0f9d8004b9aa98e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87589', 'name': 'v_de74dbb1-1657-4193-9520-50cfa823199b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot v_de74dbb1-1657-4193-9520-50cfa823199b of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3661646666666433', 'lun': 0, 'mode': 'wt', 'name': 'v_9cdf2c58-c295-483e-b766-13e01129ede2', 'prod_id': 'Storage', 'scsi_id': '6adfffd359b42273'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] add credentails to target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'name': 'MjAZDWGc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] initialize_connection for 9cdf2c58-c295-483e-b766-13e01129ede2 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:25:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MjAZDWGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '31fe831d-8c6a-42ad-8f44-9b1909b9df01'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:25:47 user cinder-volume[73393]: INFO cinder.volume.manager [req-73dfdb1e-0807-432c-bf28-6bfdb163a434 req-a5945b69-404d-4779-9fff-0ab53e8acde4 tempest-ServerActionsTestJSON-1048786641 None] attachment_update completed successfully. Apr 14 04:25:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] atach volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee to target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:25:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot 920e0be0-a7a6-4a21-a78a-451b09f475ff for volume 8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] cloning v_8ee7c552-e40e-4341-992f-722c82128913 to s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_de74dbb1-1657-4193-9520-50cfa823199b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot v_de74dbb1-1657-4193-9520-50cfa823199b deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=75,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=30,cinder:SELECT=66,cinder:DELETE=2,cinder:INSERT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.quota [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['e3c34c21-6fbb-4bc1-9cfe-b2cb55958073', '867ae4e6-66c6-4db9-bf77-f512e2298ddb', '8f85a636-f397-4f79-ab2f-743192c69fcd', '217ba269-1112-4e7c-b23c-f05886c351b9'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3734376634363865', 'lun': 0, 'mode': 'wt', 'name': 'v_d8f57c49-602f-450f-8b9e-69f1f0255cee', 'prod_id': 'Storage', 'scsi_id': '747f468ec93ea564'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] add credentails to target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot 00fc4930-62d9-4b3a-913e-e004b9aeb862 for volume b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 to s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HfrLsjmV'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114248187904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.manager [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:25:50 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Deleted volume successfully. Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] initialize_connection for d8f57c49-602f-450f-8b9e-69f1f0255cee 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-3a9c2141-916a-4f5f-b205-1cf5ee3970a9 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-de74dbb1-1657-4193-9520-50cfa823199b-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfrLsjmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9c3f0ff7-d8ee-47ff-b86d-78661c6187a1'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:25:50 user cinder-volume[73393]: INFO cinder.volume.manager [req-821f1dd4-d2e1-4816-bea4-392d5e29a118 req-ea609206-85a7-4e34-b1bb-165fd4a637d7 tempest-TestMinimumBasicScenario-1872250892 None] attachment_update completed successfully. Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_920e0be0-a7a6-4a21-a78a-451b09f475ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] create volume s_920e0be0-a7a6-4a21-a78a-451b09f475ff from snapshot s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913@s_920e0be0-a7a6-4a21-a78a-451b09f475ff', 'is_clone': True, 'full_name': 'Pool-0/s_920e0be0-a7a6-4a21-a78a-451b09f475ff', 'name': 's_920e0be0-a7a6-4a21-a78a-451b09f475ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_00fc4930-62d9-4b3a-913e-e004b9aeb862'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_00fc4930-62d9-4b3a-913e-e004b9aeb862 from snapshot s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] volume s_920e0be0-a7a6-4a21-a78a-451b09f475ff properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:25:52 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7ed7b911-b086-49fb-8fd6-c70b622585e4 tempest-SnapshotDataIntegrityTests-502963555 None] Create snapshot completed successfully Apr 14 04:25:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot ebfb94ca-56aa-463a-aa4c-b5ad41138884 for volume 8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:25:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] cloning v_8ee7c552-e40e-4341-992f-722c82128913 to s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_00fc4930-62d9-4b3a-913e-e004b9aeb862', 'is_clone': True, 'full_name': 'Pool-0/s_00fc4930-62d9-4b3a-913e-e004b9aeb862', 'name': 's_00fc4930-62d9-4b3a-913e-e004b9aeb862'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_00fc4930-62d9-4b3a-913e-e004b9aeb862 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:25:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e8059555-f8ca-4a59-9254-dacc8aaaad51 tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (0fb15a31-e124-4b0a-ae61-46e9ba24645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c5be6d-56ad-4e4d-a65b-31a6c82045a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c5be6d-56ad-4e4d-a65b-31a6c82045a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1802551281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=82554171-f944-4021-b0b4-09e74236c22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:25:54Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fc67ef-071e-4c75-9cfd-2b0c055fd590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fc67ef-071e-4c75-9cfd-2b0c055fd590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1392523-af6c-4050-8a76-cd5e4acb95eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1392523-af6c-4050-8a76-cd5e4acb95eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82554171-f944-4021-b0b4-09e74236c22d', 'volume_name': 'volume-82554171-f944-4021-b0b4-09e74236c22d', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf18be-1bdd-4f1e-bf28-4f8149c71738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf18be-1bdd-4f1e-bf28-4f8149c71738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0311e5-944a-4d46-a2c6-b1bc7820512c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Volume 82554171-f944-4021-b0b4-09e74236c22d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82554171-f944-4021-b0b4-09e74236c22d', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Cloning 82554171-f944-4021-b0b4-09e74236c22d from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 25, 54, 138052)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 25, 54, 156678)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] create snapshot v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ebfb94ca-56aa-463a-aa4c-b5ad41138884'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] create volume s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 from snapshot s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-00fc4930-62d9-4b3a-913e-e004b9aeb862-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-00fc4930-62d9-4b3a-913e-e004b9aeb862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_00fc4930-62d9-4b3a-913e-e004b9aeb862. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_00fc4930-62d9-4b3a-913e-e004b9aeb862 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_00fc4930-62d9-4b3a-913e-e004b9aeb862', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_00fc4930-62d9-4b3a-913e-e004b9aeb862', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447761', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115413', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10893943744302474086', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0c75836bd77c6d2a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114247729152', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89239', 'name': 's_00fc4930-62d9-4b3a-913e-e004b9aeb862', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_00fc4930-62d9-4b3a-913e-e004b9aeb862 of volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_82554171-f944-4021-b0b4-09e74236c22d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] create volume v_82554171-f944-4021-b0b4-09e74236c22d from snapshot v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913@s_ebfb94ca-56aa-463a-aa4c-b5ad41138884', 'is_clone': True, 'full_name': 'Pool-0/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884', 'name': 's_ebfb94ca-56aa-463a-aa4c-b5ad41138884'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] volume s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:25:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a951d688-43b0-438e-a02f-88ef8747bc5e tempest-SnapshotDataIntegrityTests-502963555 None] Create snapshot completed successfully Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot 5dab436b-0543-4a34-92eb-ba093c0be7b0 for volume 8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] cloning v_8ee7c552-e40e-4341-992f-722c82128913 to s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_82554171-f944-4021-b0b4-09e74236c22d', 'is_clone': True, 'full_name': 'Pool-0/v_82554171-f944-4021-b0b4-09e74236c22d', 'name': 'v_82554171-f944-4021-b0b4-09e74236c22d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] get volume v_82554171-f944-4021-b0b4-09e74236c22d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_82554171-f944-4021-b0b4-09e74236c22d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_82554171-f944-4021-b0b4-09e74236c22d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447764', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115425', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '717590863778262062', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c0556ee4041247dc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114247413760', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88856', 'name': 'v_82554171-f944-4021-b0b4-09e74236c22d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Marking volume 82554171-f944-4021-b0b4-09e74236c22d as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 82554171-f944-4021-b0b4-09e74236c22d. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Creating volume glance metadata for volume 82554171-f944-4021-b0b4-09e74236c22d backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0311e5-944a-4d46-a2c6-b1bc7820512c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82554171-f944-4021-b0b4-09e74236c22d', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1c4f32-36e4-4462-847f-03e12cc608dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:25:57 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Volume volume-82554171-f944-4021-b0b4-09e74236c22d (82554171-f944-4021-b0b4-09e74236c22d): created successfully Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1c4f32-36e4-4462-847f-03e12cc608dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (0fb15a31-e124-4b0a-ae61-46e9ba24645d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:25:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a5904c28-427d-47c1-a187-cb44b082b08b tempest-TestVolumeBootPattern-1780160917 None] Created volume successfully. Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_00fc4930-62d9-4b3a-913e-e004b9aeb862 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_00fc4930-62d9-4b3a-913e-e004b9aeb862 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.quota [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['2aba59c5-1aa0-4962-8aef-f731152a418d', 'da19084a-b107-4eb9-8563-a500bfc134d6', 'b522ddd3-585f-41a6-981e-d8be75d747c2', 'fc0fc4a6-d6e8-4f4e-b168-496983acc56d'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:25:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-74649450-5be1-4cce-a238-2d24a4d2aedf tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-00fc4930-62d9-4b3a-913e-e004b9aeb862-delete_snapshot" released by "delete_snapshot" :: held 2.915s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] create snapshot 1a977934-32df-4abc-b8da-83e57587448a for volume 82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] cloning v_82554171-f944-4021-b0b4-09e74236c22d to s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] create snapshot s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot ac32b119-4698-40d3-8e49-8021d43b62f7 for volume b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 to s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_5dab436b-0543-4a34-92eb-ba093c0be7b0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] create volume s_5dab436b-0543-4a34-92eb-ba093c0be7b0 from snapshot s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_1a977934-32df-4abc-b8da-83e57587448a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] create volume s_1a977934-32df-4abc-b8da-83e57587448a from snapshot s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913@s_5dab436b-0543-4a34-92eb-ba093c0be7b0', 'is_clone': True, 'full_name': 'Pool-0/s_5dab436b-0543-4a34-92eb-ba093c0be7b0', 'name': 's_5dab436b-0543-4a34-92eb-ba093c0be7b0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ac32b119-4698-40d3-8e49-8021d43b62f7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_ac32b119-4698-40d3-8e49-8021d43b62f7 from snapshot s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:25:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] volume s_5dab436b-0543-4a34-92eb-ba093c0be7b0 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:25:59 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2d1b0b8e-d3b8-462a-aa64-08c92bbeda2e tempest-SnapshotDataIntegrityTests-502963555 None] Create snapshot completed successfully Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_82554171-f944-4021-b0b4-09e74236c22d@s_1a977934-32df-4abc-b8da-83e57587448a', 'is_clone': True, 'full_name': 'Pool-0/s_1a977934-32df-4abc-b8da-83e57587448a', 'name': 's_1a977934-32df-4abc-b8da-83e57587448a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] volume s_1a977934-32df-4abc-b8da-83e57587448a properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=12,cinder:UPDATE=23,cinder:SELECT=62,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8a807caf-3abd-4b89-ab3c-68affe91f767 tempest-TestVolumeBootPattern-1780160917 None] Create snapshot completed successfully Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_ac32b119-4698-40d3-8e49-8021d43b62f7', 'is_clone': True, 'full_name': 'Pool-0/s_ac32b119-4698-40d3-8e49-8021d43b62f7', 'name': 's_ac32b119-4698-40d3-8e49-8021d43b62f7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_ac32b119-4698-40d3-8e49-8021d43b62f7 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:26:00 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=55,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=16 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e70d0085-4921-40f9-9978-b390f3d34015 tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] terminate connection for 8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:26:01 user cinder-volume[73393]: INFO cinder.volume.manager [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Terminate volume connection completed successfully. Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Deleting attachment cd50f445-165e-4fa4-94e8-183e38b93c10. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: 8ee7c552-e40e-4341-992f-722c82128913. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2031203237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8ee7c552-e40e-4341-992f-722c82128913,launched_at=2023-04-14T04:25:36Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP lSBjntEJ YE5qVP3ntzMbhu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:35Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:26:00Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_8ee7c552-e40e-4341-992f-722c82128913 from target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f46f2647-2e71-425b-b985-cefd73608fd8 req-d2ae6d0c-44f3-4fda-a95c-e572ee0c3f25 tempest-SnapshotDataIntegrityTests-502963555 None] target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (918404a9-1ecf-4177-b7bd-b2e59a027221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae9d8c-c3db-4f53-a712-38e1aeff26f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae9d8c-c3db-4f53-a712-38e1aeff26f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=24291e20-0b7c-4b2c-9351-0e6cd072508f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a977934-32df-4abc-b8da-83e57587448a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:26:04Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c27bf7-1d9e-4be9-9d87-837ea784cf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c27bf7-1d9e-4be9-9d87-837ea784cf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f9a126-6906-4b80-8f21-6cf2007fd599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f9a126-6906-4b80-8f21-6cf2007fd599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24291e20-0b7c-4b2c-9351-0e6cd072508f', 'volume_name': 'volume-24291e20-0b7c-4b2c-9351-0e6cd072508f', 'volume_size': 1, 'snapshot_id': '1a977934-32df-4abc-b8da-83e57587448a'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f3743b-70fa-4bee-b7b4-04c1dee841eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f3743b-70fa-4bee-b7b4-04c1dee841eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd8ede7-6d89-4c26-b1b0-9e73a5fd5582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:03 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Volume 24291e20-0b7c-4b2c-9351-0e6cd072508f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24291e20-0b7c-4b2c-9351-0e6cd072508f', 'volume_size': 1, 'snapshot_id': '1a977934-32df-4abc-b8da-83e57587448a'} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] create volume 24291e20-0b7c-4b2c-9351-0e6cd072508f from snapshot 1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] cloning s_1a977934-32df-4abc-b8da-83e57587448a to v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] create snapshot v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_24291e20-0b7c-4b2c-9351-0e6cd072508f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] create volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f from snapshot v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:26:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_1a977934-32df-4abc-b8da-83e57587448a@v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'is_clone': True, 'full_name': 'Pool-0/v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'name': 'v_24291e20-0b7c-4b2c-9351-0e6cd072508f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] get volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_1a977934-32df-4abc-b8da-83e57587448a@v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447774', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115457', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14260167242456241079', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bea937730033076b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114247258112', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88361', 'name': 'v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Marking volume 24291e20-0b7c-4b2c-9351-0e6cd072508f as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Copying metadata from snapshot 1a977934-32df-4abc-b8da-83e57587448a to 24291e20-0b7c-4b2c-9351-0e6cd072508f. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd8ede7-6d89-4c26-b1b0-9e73a5fd5582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24291e20-0b7c-4b2c-9351-0e6cd072508f', 'volume_size': 1, 'snapshot_id': '1a977934-32df-4abc-b8da-83e57587448a'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2562bdb2-acaf-42ce-b600-b6448bbf49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:06 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Volume volume-24291e20-0b7c-4b2c-9351-0e6cd072508f (24291e20-0b7c-4b2c-9351-0e6cd072508f): created successfully Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2562bdb2-acaf-42ce-b600-b6448bbf49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (918404a9-1ecf-4177-b7bd-b2e59a027221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:06 user cinder-volume[73393]: INFO cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-58fa5a4c-faed-451c-aba4-0fc22d7c6451 tempest-TestVolumeBootPattern-1780160917 None] Created volume successfully. Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] create export for volume: 24291e20-0b7c-4b2c-9351-0e6cd072508f. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] ensure volume 24291e20-0b7c-4b2c-9351-0e6cd072508f assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] check if targe iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] create target and attach volume 24291e20-0b7c-4b2c-9351-0e6cd072508f to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] create target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Flow 'volume_create_manager' (31127a11-0332-4264-8f08-e8b9bba06dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4cd993-0f9d-4d5a-b055-5a37da285be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4cd993-0f9d-4d5a-b055-5a37da285be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1698950194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bcb3b184-a10d-482d-8c49-1bee42873be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e15d3d3e0943c4b6bd54abf2de5fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:26:14Z,use_quota=True,user_id='36b6981092424de781e8403946f956d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af73355-7efa-493f-b59b-70eb7f32274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af73355-7efa-493f-b59b-70eb7f32274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13f9359-35a8-4b5e-80f9-a08326890e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13f9359-35a8-4b5e-80f9-a08326890e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcb3b184-a10d-482d-8c49-1bee42873be4', 'volume_name': 'volume-bcb3b184-a10d-482d-8c49-1bee42873be4', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef984e20-9b72-4580-b12f-5ef618e52ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef984e20-9b72-4580-b12f-5ef618e52ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0eb108-d606-433e-8f42-705add48d583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Volume bcb3b184-a10d-482d-8c49-1bee42873be4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcb3b184-a10d-482d-8c49-1bee42873be4', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Cloning bcb3b184-a10d-482d-8c49-1bee42873be4 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.027s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] atach volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f to target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 26, 13, 845671)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 26, 13, 869377)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] create snapshot v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_bcb3b184-a10d-482d-8c49-1bee42873be4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] create volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 from snapshot v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6265613933373733', 'lun': 0, 'mode': 'wt', 'name': 'v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'prod_id': 'Storage', 'scsi_id': 'bea937730033076b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] add credentails to target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PxcrKdyl'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] initialize_connection for 24291e20-0b7c-4b2c-9351-0e6cd072508f 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:26:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxcrKdyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ea1f39d1-7b26-4825-bff6-cb389473233a'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:26:15 user cinder-volume[73393]: INFO cinder.volume.manager [req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 req-8d62d6e7-2ff1-41d7-9255-770298fa4c43 tempest-TestVolumeBootPattern-1780160917 None] attachment_update completed successfully. Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'is_clone': True, 'full_name': 'Pool-0/v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'name': 'v_bcb3b184-a10d-482d-8c49-1bee42873be4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] get volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447784', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115468', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3974234238099508215', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1d3ba59022c2b5d2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114247221248', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89366', 'name': 'v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Marking volume bcb3b184-a10d-482d-8c49-1bee42873be4 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Creating volume glance metadata for volume bcb3b184-a10d-482d-8c49-1bee42873be4 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0eb108-d606-433e-8f42-705add48d583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb3b184-a10d-482d-8c49-1bee42873be4', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069e9fe1-71c5-43b3-87a7-86ceb6f87064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Volume volume-bcb3b184-a10d-482d-8c49-1bee42873be4 (bcb3b184-a10d-482d-8c49-1bee42873be4): created successfully Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069e9fe1-71c5-43b3-87a7-86ceb6f87064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Flow 'volume_create_manager' (31127a11-0332-4264-8f08-e8b9bba06dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-81c5c478-653c-4600-9ed0-83766de9c330 tempest-TestShelveInstance-1458140851 None] Created volume successfully. Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Acquiring lock "cinder-76b8598c-a7c5-4cc7-bd79-eb7d98b3da66-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Lock "cinder-76b8598c-a7c5-4cc7-bd79-eb7d98b3da66-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] remove_export for volume: 76b8598c-a7c5-4cc7-bd79-eb7d98b3da66. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-164022579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=76b8598c-a7c5-4cc7-bd79-eb7d98b3da66,launched_at=2023-04-14T04:22:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d389bb78d2e40b9b07d2d3ecdb7566b',provider_auth='CHAP kSWhTJji xR980OBDTigGmE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:25Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:26:17Z,updated_at=2023-04-14T04:26:17Z,use_quota=True,user_id='d2561bbc0c6d447da333ffdbb9fdc5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] detach volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 from target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/luns/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] failed to remove resource iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 because of JDSS resource v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] delete target: iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] delete target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] failed to remove resource iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 because of JDSS resource iqn.2010-10.org.openstack:76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] deleating volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] get snapshots for volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] get volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447554', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115158', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12183788515654180073', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '09fbde8626da8717', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114247208960', 'san:volume_id': '09fbde8626da8717f12ba990bcd1bcb0e8e80c5a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87036', 'name': 'v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] delete volume:v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] volume v_76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:26:19 user cinder-volume[73393]: DEBUG cinder.quota [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Created reservations ['400747e4-e70a-4e3f-ad5f-3e0113c8d804', '9a792647-5767-44d0-9a51-d3bed2ae6e9a', '17a042d6-79fe-495a-847b-1eb5552dda43', '80b67f7c-0b75-4207-96aa-9675d08cc408'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:26:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:26:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:26:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Geting {'code': 200, 'error': None, 'data': {'available': '114247303168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.manager [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:26:20 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Deleted volume successfully. Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4ab7e613-d024-4339-ab46-ab102c6976f9 tempest-VolumesAdminNegativeTest-618964915 None] Lock "cinder-76b8598c-a7c5-4cc7-bd79-eb7d98b3da66-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] create export for volume: bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] ensure volume bcb3b184-a10d-482d-8c49-1bee42873be4 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] check if targe iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] create target and attach volume bcb3b184-a10d-482d-8c49-1bee42873be4 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] create target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] atach volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 to target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114247290880', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:26:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3164336261353930', 'lun': 0, 'mode': 'wt', 'name': 'v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'prod_id': 'Storage', 'scsi_id': '1d3ba59022c2b5d2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] add credentails to target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 201, 'error': None, 'data': {'name': 'pRhHtNJB'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] initialize_connection for bcb3b184-a10d-482d-8c49-1bee42873be4 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=15,cinder:SELECT=58,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:26 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRhHtNJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'bf5d96e9-8dbd-4ab4-97b5-3681b55419a4'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:26:26 user cinder-volume[73393]: INFO cinder.volume.manager [req-975c9fcd-0b03-4103-afc9-56d439ada8a6 req-9329f6b2-1908-4ce4-bba3-2b4044c993a9 tempest-TestShelveInstance-1458140851 None] attachment_update completed successfully. Apr 14 04:26:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=68,cinder:INSERT=16,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Flow 'volume_create_manager' (d3fb5132-8525-433c-b537-51e12d982353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bda08ff-ee99-405e-8420-faf7f2c84d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bda08ff-ee99-405e-8420-faf7f2c84d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=701184e5-5014-47bb-9e2d-96aea84d6566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de251fb9f9c4a51bdb48f86d24e01ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:26:27Z,use_quota=True,user_id='8d37dd86dfe54ca080152badf3e9ccd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c583d15e-ca04-4704-be81-8729867db910),volume_type_id=c583d15e-ca04-4704-be81-8729867db910)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4eb6f-a9fd-4c2e-a6e5-db4c6aed1d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4eb6f-a9fd-4c2e-a6e5-db4c6aed1d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3aed7f8-da64-4255-aa9a-47591882a2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3aed7f8-da64-4255-aa9a-47591882a2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '701184e5-5014-47bb-9e2d-96aea84d6566', 'volume_name': 'volume-701184e5-5014-47bb-9e2d-96aea84d6566', 'volume_size': 1, 'image_id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a975ec76c70a75707e23ee8d51f1237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0de251fb9f9c4a51bdb48f86d24e01ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77a387f013ac2979c1f3cef7cd4524e029b0ef50394ae49e9c4fd5c3532463d3ef017773ee55b1f57d4e9fc59e41e2546f5454acbace38baa307ad48099945ea', 'id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'created_at': datetime.datetime(2023, 4, 14, 4, 26, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 26, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5478a6cf-fcae-4c31-b046-960c95df65e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ba440f-fe86-44a2-9f42-3cb2f9514ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ba440f-fe86-44a2-9f42-3cb2f9514ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf9bb2b-0aba-4fdb-9f61-cfc4d17bb12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Volume 701184e5-5014-47bb-9e2d-96aea84d6566: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-701184e5-5014-47bb-9e2d-96aea84d6566', 'volume_size': 1, 'image_id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a975ec76c70a75707e23ee8d51f1237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0de251fb9f9c4a51bdb48f86d24e01ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77a387f013ac2979c1f3cef7cd4524e029b0ef50394ae49e9c4fd5c3532463d3ef017773ee55b1f57d4e9fc59e41e2546f5454acbace38baa307ad48099945ea', 'id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'created_at': datetime.datetime(2023, 4, 14, 4, 26, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 26, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5478a6cf-fcae-4c31-b046-960c95df65e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Cloning 701184e5-5014-47bb-9e2d-96aea84d6566 from image 5478a6cf-fcae-4c31-b046-960c95df65e5 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Acquiring lock "cinder-5478a6cf-fcae-4c31-b046-960c95df65e5" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "cinder-5478a6cf-fcae-4c31-b046-960c95df65e5" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Preparing cache entry for image = 5478a6cf-fcae-4c31-b046-960c95df65e5 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Attempting to retrieve cache entry for image = 5478a6cf-fcae-4c31-b046-960c95df65e5 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:26:27 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2, size 0.00 MB, duration 1.00 sec {{(pid=73393) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 04:26:27 user cinder-volume[73393]: INFO cinder.image.image_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Image download 0.00 MB at 0.00 MB/s Apr 14 04:26:27 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:27 user sudo[92580]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 Apr 14 04:26:27 user sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:26:28 user sudo[92580]: pam_unix(sudo:session): session closed for user root Apr 14 04:26:28 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2" returned: 0 in 0.744s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:28 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Temporary image 5478a6cf-fcae-4c31-b046-960c95df65e5 is fetched for user 8d37dd86dfe54ca080152badf3e9ccd0. {{(pid=73393) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 04:26:28 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:28 user sudo[92602]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 Apr 14 04:26:28 user sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:26:29 user sudo[92602]: pam_unix(sudo:session): session closed for user root Apr 14 04:26:29 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2" returned: 0 in 0.753s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] creating volume v_701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:26:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] create volume {'name': 'v_701184e5-5014-47bb-9e2d-96aea84d6566', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:26:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_701184e5-5014-47bb-9e2d-96aea84d6566', 'is_clone': False, 'name': 'v_701184e5-5014-47bb-9e2d-96aea84d6566'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Attempting download of 5478a6cf-fcae-4c31-b046-960c95df65e5 ((None, None)) to volume 701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] copy_image_to_volume volume-701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG os_brick.utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b291d76-5036-441c-99fb-881a5e2f4619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66f2ad7cf0e5\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b531271-c7d2-4a29-8e00-020569ed5498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[29433552-be54-45d7-a744-128083ffbd6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1efd68-cae9-4058-be60-69ccb2d1f504]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): nvme version {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] 'nvme version' failed. Not Retrying. {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] nvme not present on system {{(pid=73393) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 04:26:30 user cinder-volume[73393]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 04:26:30 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95380a-6b5f-49c0-aace-75609f350e34]: (4, '') {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73393) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73393) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.lightos [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] LIGHTOS: no hostnqn found. {{(pid=73393) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG os_brick.utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66f2ad7cf0e5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Volume 701184e5-5014-47bb-9e2d-96aea84d6566: creating export {{(pid=73393) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] create export for volume: 701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] ensure volume 701184e5-5014-47bb-9e2d-96aea84d6566 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] check if targe iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] create target and attach volume 701184e5-5014-47bb-9e2d-96aea84d6566 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] create target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] atach volume v_701184e5-5014-47bb-9e2d-96aea84d6566 to target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:26:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3564396536633162', 'lun': 0, 'mode': 'wt', 'name': 'v_701184e5-5014-47bb-9e2d-96aea84d6566', 'prod_id': 'Storage', 'scsi_id': '5d9e6c1b0fef995c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] add credentails to target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:26:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 201, 'error': None, 'data': {'name': 'nCTNpVWZ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] initialize_connection for 701184e5-5014-47bb-9e2d-96aea84d6566 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connector [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Factory for iscsi on None {{(pid=73393) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCTNpVWZ', 'auth_password': '***', 'target_lun': False}}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:26:36 user cinder-volume[73393]: INFO os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc0ce38-f11b-45ab-ba61-6ba9252a420c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 04:26:36 user cinder-volume[73393]: {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --interface default --op new {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab566588-6eed-4afa-849a-c870b0136c2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566] added\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566] added Apr 14 04:26:36 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[26313ab7-c90c-4e32-bd60-f1dc9db9a67b]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e0d92b-4b9e-4ca1-ac95-bef332478b06]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCTNpVWZ {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCTNpVWZ" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bceed1-9f27-4261-8e3e-dbc1379e5dde]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nCTNpVWZ'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[12230829-7e48-412a-b03c-84f401de4a1c]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[84899f9e-c743-4812-9b10-df825ac0f4aa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash) Apr 14 04:26:36 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:26:36 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --login {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --login" returned: 0 in 1.071s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a131fd8-8d0f-4734-b54a-2c39bb13e350]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260] Apr 14 04:26:37 user cinder-volume[73393]: Login to [iface: default, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260] successful. Apr 14 04:26:37 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de68bc4-e813-4f9a-8245-47298630079e]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f891b4-dc71-4ec6-86f2-a1bd31e8edfb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 (non-flash) Apr 14 04:26:37 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.299s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Connected to 172.16.0.220:3260 {{(pid=73393) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=73393) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Scanning host 38 c: -, t: -, l: 0) {{(pid=73393) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[d792fe58-999a-4e8e-8b49-b25c49d9c6da]: (4, ('- - 0', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73393) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 04:26:37 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCTNpVWZ', 'auth_password': '***', 'target_lun': False} {{(pid=73393) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 04:26:38 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.343s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:26:38 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] <== connect_volume: return (2344ms) {'type': 'block', 'scsi_wwn': '23564396536633162', 'path': '/dev/sdg'} {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:26:38 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdg of=/dev/null count=1 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:38 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdg of=/dev/null count=1" returned: 0 in 0.038s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:38 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d3836a-9149-46e2-8736-2d73080f7f82]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00267984 s, 191 kB/s\n')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:38 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_5478a6cf-fcae-4c31-b046-960c95df65e5_c5hk6_gc {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:38 user sudo[92831]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_5478a6cf-fcae-4c31-b046-960c95df65e5_c5hk6_gc Apr 14 04:26:38 user sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:26:39 user sudo[92831]: pam_unix(sudo:session): session closed for user root Apr 14 04:26:39 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_5478a6cf-fcae-4c31-b046-960c95df65e5_c5hk6_gc" returned: 0 in 0.750s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:39 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:39 user sudo[92835]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 Apr 14 04:26:39 user sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:26:40 user sudo[92835]: pam_unix(sudo:session): session closed for user root Apr 14 04:26:40 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2" returned: 0 in 0.775s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:40 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] 5478a6cf-fcae-4c31-b046-960c95df65e5 was raw, converting to raw {{(pid=73393) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 04:26:40 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 of=/dev/sdg oflag=direct {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:40 user sudo[92840]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 of=/dev/sdg oflag=direct Apr 14 04:26:40 user sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:26:40 user sudo[92840]: pam_unix(sudo:session): session closed for user root Apr 14 04:26:40 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 of=/dev/sdg oflag=direct" returned: 0 in 0.690s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:40 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 /dev/sdg {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:40 user sudo[92849]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 /dev/sdg Apr 14 04:26:40 user sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:26:41 user sudo[92849]: pam_unix(sudo:session): session closed for user root Apr 14 04:26:41 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 /dev/sdg" returned: 0 in 0.698s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:41 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:41 user sudo[92864]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2 Apr 14 04:26:41 user sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 04:26:42 user sudo[92864]: pam_unix(sudo:session): session closed for user root Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2" returned: 0 in 0.774s {{(pid=73393) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5478a6cf-fcae-4c31-b046-960c95df65e5_y39o60s1user@joviandss-2, size 0.00 MB, duration 1.00 sec, destination /dev/sdg {{(pid=73393) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 04:26:42 user cinder-volume[73393]: INFO cinder.image.image_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Converted 0.00 MB image at 0.00 MB/s Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCTNpVWZ', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23564396536633162', 'path': '/dev/sdg'}), 'kwargs': {'force': False}}" {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d07baf-b368-4396-9e5b-d026f46879a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 04:26:42 user cinder-volume[73393]: No targets found. Apr 14 04:26:42 user cinder-volume[73393]: iSNS: Apr 14 04:26:42 user cinder-volume[73393]: No targets found. Apr 14 04:26:42 user cinder-volume[73393]: STATIC: Apr 14 04:26:42 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f Apr 14 04:26:42 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:26:42 user cinder-volume[73393]: Iface Name: default Apr 14 04:26:42 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee Apr 14 04:26:42 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:26:42 user cinder-volume[73393]: Iface Name: default Apr 14 04:26:42 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 Apr 14 04:26:42 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:26:42 user cinder-volume[73393]: Iface Name: default Apr 14 04:26:42 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 Apr 14 04:26:42 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:26:42 user cinder-volume[73393]: Iface Name: default Apr 14 04:26:42 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 Apr 14 04:26:42 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:26:42 user cinder-volume[73393]: Iface Name: default Apr 14 04:26:42 user cinder-volume[73393]: Target: iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 Apr 14 04:26:42 user cinder-volume[73393]: Portal: 172.16.0.220:3260,-1 Apr 14 04:26:42 user cinder-volume[73393]: Iface Name: default Apr 14 04:26:42 user cinder-volume[73393]: FIRMWARE: Apr 14 04:26:42 user cinder-volume[73393]: No targets found. Apr 14 04:26:42 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 04:26:42 user cinder-volume[73393]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 04:26:42 user cinder-volume[73393]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73393) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566', 0)] {{(pid=73393) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0857a5-604c-4df3-a680-0996a8726b3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a05e9e5-6db1-42f2-ad76-4a3b6a064993]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 (non-flash)\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 (non-flash) Apr 14 04:26:42 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Resulting device map defaultdict(. at 0x7fd679261510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566'): ({'sdg'}, set())}) {{(pid=73393) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Removing single pathed devices sdg {{(pid=73393) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e136b4d-1f65-43c8-b666-2e5c26a0f46b]: (4, ('path checker states:\nup 6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f217920-6e95-4483-a87a-da4921b39e69]: (4, ('ok\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Flushing IO for device /dev/sdg {{(pid=73393) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[76138e25-7b49-4252-891f-141630088c6b]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73393) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.135s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[03190c7a-5c98-491c-b359-e7578f19b704]: (4, ('1', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=73393) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.linuxscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] SCSI volumes sdg have been removed. {{(pid=73393) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566')] {{(pid=73393) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f3a86-9632-45e6-a404-1c3555f11d67]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --logout {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --logout" returned: 0 in 0.155s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94c8eb6-2ddf-4b54-8088-dfe1e016551f]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260] Apr 14 04:26:42 user cinder-volume[73393]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566, portal: 172.16.0.220,3260] successful. Apr 14 04:26:42 user cinder-volume[73393]: stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op delete {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81102) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341a23e-22ce-4461-bfec-0aa5c5bb5400]: (4, ('', '')) {{(pid=81102) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73393) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.base [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=73393) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] <== disconnect_volume: return (505ms) None {{(pid=73393) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] terminate connection for 701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.driver [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] volume 701184e5-5014-47bb-9e2d-96aea84d6566: removing export {{(pid=73393) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] remove_export for volume: 701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=701184e5-5014-47bb-9e2d-96aea84d6566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de251fb9f9c4a51bdb48f86d24e01ee',provider_auth='CHAP nCTNpVWZ e8z6lSPdUjxBYa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T04:26:27Z,use_quota=True,user_id='8d37dd86dfe54ca080152badf3e9ccd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c583d15e-ca04-4704-be81-8729867db910),volume_type_id=c583d15e-ca04-4704-be81-8729867db910) from target:iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] detach volume v_701184e5-5014-47bb-9e2d-96aea84d6566 from target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] delete target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] delete target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Downloaded image 5478a6cf-fcae-4c31-b046-960c95df65e5 ((None, None)) to volume 701184e5-5014-47bb-9e2d-96aea84d6566 successfully. {{(pid=73393) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.image.image_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Temporary image 5478a6cf-fcae-4c31-b046-960c95df65e5 for user 8d37dd86dfe54ca080152badf3e9ccd0 is deleted. {{(pid=73393) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 04:26:43 user cinder-volume[73393]: WARNING cinder.quota [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:26:43 user cinder-volume[73393]: WARNING cinder.quota [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.quota [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Created reservations ['42147554-0f0d-44ee-8db5-4fa45b296716', '20f7a8d2-482f-4abd-b60d-8d375fdffe1c', '29720f43-cc1b-41b1-b503-f072049b5df3', 'bf179ccf-8305-4d1b-bacc-e59998484051'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Creating image volume entry: {'provider_id': None, 'replication_extended_status': None, 'bootable': False, 'previous_status': None, 'service_uuid': None, 'metadata': {}, 'updated_at': datetime.datetime(2023, 4, 14, 4, 26, 27, tzinfo=datetime.timezone.utc), 'consistencygroup_id': None, 'terminated_at': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'deleted_at': None, 'volume_type_id': 'c583d15e-ca04-4704-be81-8729867db910', 'replication_driver_data': None, 'display_description': None, 'multiattach': False, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 0', 'size': 1, 'scheduled_at': datetime.datetime(2023, 4, 14, 4, 26, 27, tzinfo=datetime.timezone.utc), 'volume_metadata': [], 'project_id': '447e3d081a064aac847d4d452695f22d', 'group_id': None, 'ec2_id': None, 'shared_targets': True, 'availability_zone': 'nova', 'provider_geometry': None, 'user_id': '8d37dd86dfe54ca080152badf3e9ccd0', 'provider_auth': 'CHAP nCTNpVWZ e8z6lSPdUjxBYa', 'volume_admin_metadata': [], 'created_at': datetime.datetime(2023, 4, 14, 4, 26, 27, tzinfo=datetime.timezone.utc), 'replication_status': None, 'encryption_key_id': None, 'host': 'user@joviandss-2#joviandss-2', 'display_name': 'image-5478a6cf-fcae-4c31-b046-960c95df65e5', 'launched_at': None, 'cluster_name': None, 'deleted': False, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '701184e5-5014-47bb-9e2d-96aea84d6566'}. {{(pid=73393) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Volume reschedule parameters: False retry: None {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Flow 'volume_create_manager' (d256802b-738e-4d9c-b011-4c9effc14bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8989721-b5ec-4fe0-b401-4a39250c2bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8989721-b5ec-4fe0-b401-4a39250c2bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='image-5478a6cf-fcae-4c31-b046-960c95df65e5',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=664e08ed-b704-43cd-ab3a-f78743f55b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='447e3d081a064aac847d4d452695f22d',provider_auth='CHAP nCTNpVWZ e8z6lSPdUjxBYa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=701184e5-5014-47bb-9e2d-96aea84d6566,status='creating',terminated_at=None,updated_at=2023-04-14T04:26:27Z,use_quota=True,user_id='8d37dd86dfe54ca080152badf3e9ccd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c583d15e-ca04-4704-be81-8729867db910),volume_type_id=c583d15e-ca04-4704-be81-8729867db910)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8257bad6-be19-49aa-9afb-a06e014fbf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8257bad6-be19-49aa-9afb-a06e014fbf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018e9664-bdfa-4afc-bf49-1caef03a4ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018e9664-bdfa-4afc-bf49-1caef03a4ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '664e08ed-b704-43cd-ab3a-f78743f55b93', 'volume_name': 'volume-664e08ed-b704-43cd-ab3a-f78743f55b93', 'volume_size': 1, 'source_volid': '701184e5-5014-47bb-9e2d-96aea84d6566', 'source_volstatus': 'downloading'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d857f-42f9-4a7e-9743-477e4fc62de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d857f-42f9-4a7e-9743-477e4fc62de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49cb997-b121-448f-a67f-68c5e403883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:43 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Volume 664e08ed-b704-43cd-ab3a-f78743f55b93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-664e08ed-b704-43cd-ab3a-f78743f55b93', 'volume_size': 1, 'source_volid': '701184e5-5014-47bb-9e2d-96aea84d6566', 'source_volstatus': 'downloading'} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] cloned volume 701184e5-5014-47bb-9e2d-96aea84d6566 to 664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] cloning v_701184e5-5014-47bb-9e2d-96aea84d6566 to v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] create snapshot v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_664e08ed-b704-43cd-ab3a-f78743f55b93'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] create volume v_664e08ed-b704-43cd-ab3a-f78743f55b93 from snapshot v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:26:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_701184e5-5014-47bb-9e2d-96aea84d6566@v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'is_clone': True, 'full_name': 'Pool-0/v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'name': 'v_664e08ed-b704-43cd-ab3a-f78743f55b93'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] get volume v_664e08ed-b704-43cd-ab3a-f78743f55b93 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_701184e5-5014-47bb-9e2d-96aea84d6566@v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447813', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '115496', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '653064302913773980', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5dc6d76b9ee4b1b0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227011584', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '88987', 'name': 'v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49cb997-b121-448f-a67f-68c5e403883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664e08ed-b704-43cd-ab3a-f78743f55b93', 'volume_size': 1, 'source_volid': '701184e5-5014-47bb-9e2d-96aea84d6566', 'source_volstatus': 'downloading'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b2e61-8472-4505-8ce6-8d7e9f877589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:46 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Volume volume-664e08ed-b704-43cd-ab3a-f78743f55b93 (664e08ed-b704-43cd-ab3a-f78743f55b93): created successfully Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b2e61-8472-4505-8ce6-8d7e9f877589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Flow 'volume_create_manager' (d256802b-738e-4d9c-b011-4c9effc14bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Created volume successfully. Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Creating new image-volume cache entry for image 5478a6cf-fcae-4c31-b046-960c95df65e5 on user@joviandss-2#joviandss-2 {{(pid=73393) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] New image-volume cache entry created: {'id': 2, 'image_id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'volume_id': '664e08ed-b704-43cd-ab3a-f78743f55b93', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 26, 26), 'last_used': datetime.datetime(2023, 4, 14, 4, 26, 46, 710363)}. {{(pid=73393) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "cinder-5478a6cf-fcae-4c31-b046-960c95df65e5" released by "_prepare_image_cache_entry" :: held 19.299s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Marking volume 701184e5-5014-47bb-9e2d-96aea84d6566 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Copying metadata from image 5478a6cf-fcae-4c31-b046-960c95df65e5 to 701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Creating volume glance metadata for volume 701184e5-5014-47bb-9e2d-96aea84d6566 backed by image 5478a6cf-fcae-4c31-b046-960c95df65e5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5a975ec76c70a75707e23ee8d51f1237', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf9bb2b-0aba-4fdb-9f61-cfc4d17bb12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701184e5-5014-47bb-9e2d-96aea84d6566', 'volume_size': 1, 'image_id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a975ec76c70a75707e23ee8d51f1237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0de251fb9f9c4a51bdb48f86d24e01ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77a387f013ac2979c1f3cef7cd4524e029b0ef50394ae49e9c4fd5c3532463d3ef017773ee55b1f57d4e9fc59e41e2546f5454acbace38baa307ad48099945ea', 'id': '5478a6cf-fcae-4c31-b046-960c95df65e5', 'created_at': datetime.datetime(2023, 4, 14, 4, 26, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 26, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5478a6cf-fcae-4c31-b046-960c95df65e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba05675-f50c-42bf-8f1a-2f2c52ef82fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:46 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Volume volume-701184e5-5014-47bb-9e2d-96aea84d6566 (701184e5-5014-47bb-9e2d-96aea84d6566): created successfully Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba05675-f50c-42bf-8f1a-2f2c52ef82fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:46 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Flow 'volume_create_manager' (d3fb5132-8525-433c-b537-51e12d982353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8f44ba7d-0d9a-4fba-a6a5-6d9841ca7adb tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Created volume successfully. Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Acquiring lock "cinder-701184e5-5014-47bb-9e2d-96aea84d6566-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "cinder-701184e5-5014-47bb-9e2d-96aea84d6566-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] remove_export for volume: 701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=701184e5-5014-47bb-9e2d-96aea84d6566,launched_at=2023-04-14T04:26:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de251fb9f9c4a51bdb48f86d24e01ee',provider_auth='CHAP nCTNpVWZ e8z6lSPdUjxBYa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:27Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:26:48Z,updated_at=2023-04-14T04:26:48Z,use_quota=True,user_id='8d37dd86dfe54ca080152badf3e9ccd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c583d15e-ca04-4704-be81-8729867db910),volume_type_id=c583d15e-ca04-4704-be81-8729867db910) from target:iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] detach volume v_701184e5-5014-47bb-9e2d-96aea84d6566 from target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns/v_701184e5-5014-47bb-9e2d-96aea84d6566'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566/luns/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] failed to remove resource iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 because of JDSS resource v_701184e5-5014-47bb-9e2d-96aea84d6566 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] delete target: iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] delete target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] failed to remove resource iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 because of JDSS resource iqn.2010-10.org.openstack:701184e5-5014-47bb-9e2d-96aea84d6566 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] deleating volume v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] get snapshots for volume v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:50:13', 'volsize': '1073741824', 'createtxg': '115494', 'guid': '11284967610690473941', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'objsetid': '88029', 'name': 'v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'defer_destroy': 'off', 'san:volume_id': '5d9e6c1b0fef995cc27968c5f66b591f52a98be8', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] volume v_701184e5-5014-47bb-9e2d-96aea84d6566 updated {{(pid=73393) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG cinder.quota [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Created reservations ['85c3ddf9-6810-4180-b1ff-2dc081c28aa3', '753a1d5b-eae3-4dc9-8621-4d98d091fe34', '32dff155-04f8-4e86-ad3e-da3b34856781', '0598e575-73aa-4574-bbad-000ba5543373'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=66,cinder:UPDATE=22,cinder:INSERT=12 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Acquiring lock "cinder-664e08ed-b704-43cd-ab3a-f78743f55b93-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Lock "cinder-664e08ed-b704-43cd-ab3a-f78743f55b93-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] remove_export for volume: 664e08ed-b704-43cd-ab3a-f78743f55b93. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='True'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='image-5478a6cf-fcae-4c31-b046-960c95df65e5',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=664e08ed-b704-43cd-ab3a-f78743f55b93,launched_at=2023-04-14T04:26:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='447e3d081a064aac847d4d452695f22d',provider_auth='CHAP qOFajSRY n43eOdIFgMECw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:27Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=701184e5-5014-47bb-9e2d-96aea84d6566,status='deleting',terminated_at=2023-04-14T04:26:50Z,updated_at=2023-04-14T04:26:50Z,use_quota=True,user_id='8d37dd86dfe54ca080152badf3e9ccd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c583d15e-ca04-4704-be81-8729867db910),volume_type_id=c583d15e-ca04-4704-be81-8729867db910) from target:iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] detach volume v_664e08ed-b704-43cd-ab3a-f78743f55b93 from target iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93/luns/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93/luns/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226831360', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.manager [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:26:50 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Deleted volume successfully. Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93/luns/v_664e08ed-b704-43cd-ab3a-f78743f55b93'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93/luns/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] failed to remove resource iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 because of JDSS resource v_664e08ed-b704-43cd-ab3a-f78743f55b93 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] delete target: iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] delete target iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e1d29377-5ab9-4f31-95e4-c823f47d4ad0 tempest-VolumeAndVolumeTypeFromImageTest-1066614285 None] Lock "cinder-701184e5-5014-47bb-9e2d-96aea84d6566-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] failed to remove resource iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 because of JDSS resource iqn.2010-10.org.openstack:664e08ed-b704-43cd-ab3a-f78743f55b93 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] deleating volume v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] get snapshots for volume v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (0785b380-0dd5-4f1f-9eec-201f84268eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387801e0-d260-4152-83c8-2827e4ba1b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387801e0-d260-4152-83c8-2827e4ba1b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2146923826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=430bf7a7-6067-4516-9a60-f895bded451d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=920e0be0-a7a6-4a21-a78a-451b09f475ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:26:51Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd91ec-9081-43fd-a980-53af8559bf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd91ec-9081-43fd-a980-53af8559bf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d64938f-899e-4b03-bb0a-437194d801fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d64938f-899e-4b03-bb0a-437194d801fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '430bf7a7-6067-4516-9a60-f895bded451d', 'volume_name': 'volume-430bf7a7-6067-4516-9a60-f895bded451d', 'volume_size': 1, 'snapshot_id': '920e0be0-a7a6-4a21-a78a-451b09f475ff'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cedbaa-9342-4354-a014-2e31fc70da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cedbaa-9342-4354-a014-2e31fc70da3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5631c6-da68-4e7e-8080-48534bfdf853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:50 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Volume 430bf7a7-6067-4516-9a60-f895bded451d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-430bf7a7-6067-4516-9a60-f895bded451d', 'volume_size': 1, 'snapshot_id': '920e0be0-a7a6-4a21-a78a-451b09f475ff'} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] create volume 430bf7a7-6067-4516-9a60-f895bded451d from snapshot 920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] cloning s_920e0be0-a7a6-4a21-a78a-451b09f475ff to v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] get volume v_664e08ed-b704-43cd-ab3a-f78743f55b93 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_701184e5-5014-47bb-9e2d-96aea84d6566@v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447813', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '115496', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '653064302913773980', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5dc6d76b9ee4b1b0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226831360', 'san:volume_id': '5dc6d76b9ee4b1b06e2c1522c10a7e3f0a512b30', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '88987', 'name': 'v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '8192', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_664e08ed-b704-43cd-ab3a-f78743f55b93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] get snapshots for volume t_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:50:13', 'volsize': '1073741824', 'createtxg': '115494', 'guid': '11284967610690473941', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'objsetid': '88029', 'name': 'v_664e08ed-b704-43cd-ab3a-f78743f55b93', 'defer_destroy': 'off', 'san:volume_id': '5d9e6c1b0fef995cc27968c5f66b591f52a98be8', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] get volume t_701184e5-5014-47bb-9e2d-96aea84d6566 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_701184e5-5014-47bb-9e2d-96aea84d6566', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447798', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '115478', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4821494534651438968', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '159744', 'compressratio': '4.87', 'rootcontext': 'none', 'default_scsi_id': '5d9e6c1b0fef995c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226831360', 'san:volume_id': '5d9e6c1b0fef995cc27968c5f66b591f52a98be8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '61440', 'objsetid': '89113', 'name': 't_701184e5-5014-47bb-9e2d-96aea84d6566', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '61440', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] delete volume:t_701184e5-5014-47bb-9e2d-96aea84d6566 recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_430bf7a7-6067-4516-9a60-f895bded451d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] create volume v_430bf7a7-6067-4516-9a60-f895bded451d from snapshot v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_701184e5-5014-47bb-9e2d-96aea84d6566 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:52 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Lock "cinder-664e08ed-b704-43cd-ab3a-f78743f55b93-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server [None req-ea0c8ded-40c1-49e4-ba08-08805f6c9a64 tempest-VolumeAndVolumeTypeFromImageTest-925773390 None] Exception during message handling: KeyError: 'errno' Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 04:26:52 user cinder-volume[73393]: ERROR oslo_messaging.rpc.server Apr 14 04:26:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_920e0be0-a7a6-4a21-a78a-451b09f475ff@v_430bf7a7-6067-4516-9a60-f895bded451d', 'is_clone': True, 'full_name': 'Pool-0/v_430bf7a7-6067-4516-9a60-f895bded451d', 'name': 'v_430bf7a7-6067-4516-9a60-f895bded451d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] get volume v_430bf7a7-6067-4516-9a60-f895bded451d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:26:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_920e0be0-a7a6-4a21-a78a-451b09f475ff@v_430bf7a7-6067-4516-9a60-f895bded451d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_430bf7a7-6067-4516-9a60-f895bded451d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447820', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '115503', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '827336783053025989', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '19f01b2857c038c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226794496', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89507', 'name': 'v_430bf7a7-6067-4516-9a60-f895bded451d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5631c6-da68-4e7e-8080-48534bfdf853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430bf7a7-6067-4516-9a60-f895bded451d', 'volume_size': 1, 'snapshot_id': '920e0be0-a7a6-4a21-a78a-451b09f475ff'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b9170a-cdec-49a5-a610-725700f291f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:26:53 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:UPDATE=24,cinder:INSERT=12,cinder:DELETE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:53 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Volume volume-430bf7a7-6067-4516-9a60-f895bded451d (430bf7a7-6067-4516-9a60-f895bded451d): created successfully Apr 14 04:26:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b9170a-cdec-49a5-a610-725700f291f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:26:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (0785b380-0dd5-4f1f-9eec-201f84268eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:26:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-73c53f70-f825-4604-9f11-86de232cdd4f tempest-SnapshotDataIntegrityTests-502963555 None] Created volume successfully. Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] create export for volume: 430bf7a7-6067-4516-9a60-f895bded451d. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] ensure volume 430bf7a7-6067-4516-9a60-f895bded451d assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] check if targe iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] create target and attach volume 430bf7a7-6067-4516-9a60-f895bded451d to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] create target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] atach volume v_430bf7a7-6067-4516-9a60-f895bded451d to target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:26:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3139663031623238', 'lun': 0, 'mode': 'wt', 'name': 'v_430bf7a7-6067-4516-9a60-f895bded451d', 'prod_id': 'Storage', 'scsi_id': '19f01b2857c038c8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] add credentails to target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:26:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:26:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:26:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'name': 'xaQKgXWG'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:26:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] initialize_connection for 430bf7a7-6067-4516-9a60-f895bded451d 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:26:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQKgXWG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'b17d6cbb-c3e4-4370-8725-f0aa44af34d9'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:26:59 user cinder-volume[73393]: INFO cinder.volume.manager [req-c9e54616-7ddf-4509-ae7c-9cb334e34657 req-1d7c053b-2599-4a3b-b2e0-b20aeb4ea61e tempest-SnapshotDataIntegrityTests-502963555 None] attachment_update completed successfully. Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] terminate connection for 430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:27:03 user cinder-volume[73393]: INFO cinder.volume.manager [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Terminate volume connection completed successfully. Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Deleting attachment b17d6cbb-c3e4-4370-8725-f0aa44af34d9. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: 430bf7a7-6067-4516-9a60-f895bded451d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2146923826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=430bf7a7-6067-4516-9a60-f895bded451d,launched_at=2023-04-14T04:26:53Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP xaQKgXWG EYkBfaNPstelFn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:51Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=920e0be0-a7a6-4a21-a78a-451b09f475ff,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:27:02Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_430bf7a7-6067-4516-9a60-f895bded451d from target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c req-832cef13-02cb-4c4f-bf29-c57747accfb9 tempest-SnapshotDataIntegrityTests-502963555 None] target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] create export for volume: 2ea04249-09da-471f-a8b5-89a901381329. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] ensure volume 2ea04249-09da-471f-a8b5-89a901381329 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] check if targe iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] create target and attach volume 2ea04249-09da-471f-a8b5-89a901381329 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] create target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] atach volume v_2ea04249-09da-471f-a8b5-89a901381329 to target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:27:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6438633635343165', 'lun': 0, 'mode': 'wt', 'name': 'v_2ea04249-09da-471f-a8b5-89a901381329', 'prod_id': 'Storage', 'scsi_id': 'd8c6541ef2997d3b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] add credentails to target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:27:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 201, 'error': None, 'data': {'name': 'dWfGZPuJ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] initialize_connection for 2ea04249-09da-471f-a8b5-89a901381329 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:27:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWfGZPuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e2a40397-a048-409f-b16d-fcaf23668422'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:27:12 user cinder-volume[73393]: INFO cinder.volume.manager [req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b req-192999e9-25e6-4e10-8346-b3fe3ef54528 tempest-ServerRescueNegativeTestJSON-508041341 None] attachment_update completed successfully. Apr 14 04:27:21 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=37,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e084c350-ebc6-43f0-8c1f-99454e6bc10a tempest-GroupSnapshotsV319Test-1512721632 None] Group tempest-GroupSnapshotsV319Test-Group-777002349: creating Apr 14 04:27:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e084c350-ebc6-43f0-8c1f-99454e6bc10a tempest-GroupSnapshotsV319Test-1512721632 None] Group tempest-GroupSnapshotsV319Test-Group-777002349: created successfully Apr 14 04:27:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e084c350-ebc6-43f0-8c1f-99454e6bc10a tempest-GroupSnapshotsV319Test-1512721632 None] Create group completed successfully. Apr 14 04:27:23 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=38,cinder:UPDATE=6 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Flow 'volume_create_manager' (d2055780-3099-4817-a5cf-5f949eeb7965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f5456c-1cac-4d19-ba7a-fced8d1873ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f5456c-1cac-4d19-ba7a-fced8d1873ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441669023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76d4ea2b-6e50-417f-879d-b08efb9d45a6,host='user@joviandss-2#joviandss-2',id=801a03bc-1610-4d68-b2ad-aed2ea648885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6e0070ca264f14b6dba3bef18c4469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:27:23Z,use_quota=True,user_id='fcc0fae325ee4e59811920944c907f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64985011-9401-40a4-942c-751feb513bc1),volume_type_id=64985011-9401-40a4-942c-751feb513bc1)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339b2424-bd7e-455c-b3d0-de13eadeedb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339b2424-bd7e-455c-b3d0-de13eadeedb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7748c22-fbf3-47bf-9401-0941139aa09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7748c22-fbf3-47bf-9401-0941139aa09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801a03bc-1610-4d68-b2ad-aed2ea648885', 'volume_name': 'volume-801a03bc-1610-4d68-b2ad-aed2ea648885', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b77ef1-b793-413c-a179-40cbea412d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b77ef1-b793-413c-a179-40cbea412d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861fc6a3-d2c8-4ee3-933d-ba486cdd1957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:23 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Volume 801a03bc-1610-4d68-b2ad-aed2ea648885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801a03bc-1610-4d68-b2ad-aed2ea648885', 'volume_size': 1} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] creating volume v_801a03bc-1610-4d68-b2ad-aed2ea648885. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] create volume {'name': 'v_801a03bc-1610-4d68-b2ad-aed2ea648885', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_801a03bc-1610-4d68-b2ad-aed2ea648885', 'is_clone': False, 'name': 'v_801a03bc-1610-4d68-b2ad-aed2ea648885'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861fc6a3-d2c8-4ee3-933d-ba486cdd1957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801a03bc-1610-4d68-b2ad-aed2ea648885', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b35865-f542-4e88-858a-11ed7aad4df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:24 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Volume volume-801a03bc-1610-4d68-b2ad-aed2ea648885 (801a03bc-1610-4d68-b2ad-aed2ea648885): created successfully Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b35865-f542-4e88-858a-11ed7aad4df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Flow 'volume_create_manager' (d2055780-3099-4817-a5cf-5f949eeb7965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:27:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2660963c-19fd-490b-b2b7-2c0f8e1d1d1b tempest-GroupSnapshotsV319Test-1512721632 None] Created volume successfully. Apr 14 04:27:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114226544640', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:27:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] GroupSnapshot 8ef63eff-82e0-460c-960e-d944c67a0cf2: creating. Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Group snapshot 8ef63eff-82e0-460c-960e-d944c67a0cf2: creating. {{(pid=73393) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] create snapshot 49f790ff-dfe4-4696-b75e-0ab4ca5bb07a for volume 801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] cloning v_801a03bc-1610-4d68-b2ad-aed2ea648885 to s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] create snapshot s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] create volume s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a from snapshot s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:27:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_801a03bc-1610-4d68-b2ad-aed2ea648885@s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a', 'is_clone': True, 'full_name': 'Pool-0/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a', 'name': 's_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] volume s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:27:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ef0f09f2-ebd7-4eef-bb33-6bf9fe97f5cd tempest-GroupSnapshotsV319Test-1512721632 None] group_snapshot 8ef63eff-82e0-460c-960e-d944c67a0cf2: created successfully Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] terminate connection for 9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:27:28 user cinder-volume[73393]: INFO cinder.volume.manager [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Terminate volume connection completed successfully. Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Deleting attachment 31fe831d-8c6a-42ad-8f44-9b1909b9df01. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1226443700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9cdf2c58-c295-483e-b766-13e01129ede2,launched_at=2023-04-14T04:25:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP MjAZDWGc KyeNwxZHQq4i1a',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:24Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:25:54Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] detach volume v_9cdf2c58-c295-483e-b766-13e01129ede2 from target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] group_snapshot 8ef63eff-82e0-460c-960e-d944c67a0cf2: deleting Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-f77ba226-0e44-4a42-8916-f72f823c748c tempest-ServerActionsTestJSON-1048786641 None] target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] group_snapshot 8ef63eff-82e0-460c-960e-d944c67a0cf2: deleting {{(pid=73393) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] deleating snapshot s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] get snapshots for volume s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] get volume s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_801a03bc-1610-4d68-b2ad-aed2ea648885@s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447855', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115530', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13697093766721859014', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8da368df61c820e6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226532352', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88875', 'name': 's_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] delete snapshot s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a of volume v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] create export for volume: 9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] ensure volume 9cdf2c58-c295-483e-b766-13e01129ede2 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] check if targe iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] create target and attach volume 9cdf2c58-c295-483e-b766-13e01129ede2 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] create target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots/s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] snapshot s_49f790ff-dfe4-4696-b75e-0ab4ca5bb07a deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:27:31 user cinder-volume[73393]: WARNING cinder.quota [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-559143218 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-559143218, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:27:31 user cinder-volume[73393]: WARNING cinder.quota [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-559143218 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-559143218, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:27:31 user cinder-volume[73393]: DEBUG cinder.quota [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] Created reservations ['e0170878-6b38-440f-bc7a-de2d5dec99b2', '01a8629d-227b-4176-9561-0bcac9e2e3ac', '47799ef0-e1fb-4212-81ab-7aa447f2f061', 'ac8f45bf-7a65-44b0-9cc3-77a80a9b66ef'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:27:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2172decb-67c4-4190-8a4a-931882854d6e tempest-GroupSnapshotsV319Test-1512721632 None] group_snapshot 8ef63eff-82e0-460c-960e-d944c67a0cf2: deleted successfully Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] remove_export for volume: 801a03bc-1610-4d68-b2ad-aed2ea648885. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441669023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76d4ea2b-6e50-417f-879d-b08efb9d45a6,host='user@joviandss-2#joviandss-2',id=801a03bc-1610-4d68-b2ad-aed2ea648885,launched_at=2023-04-14T04:27:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6e0070ca264f14b6dba3bef18c4469',provider_auth='CHAP bUdJDqBp bfBFJAwtxMkgC4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:27:23Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:27:33Z,use_quota=True,user_id='fcc0fae325ee4e59811920944c907f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64985011-9401-40a4-942c-751feb513bc1),volume_type_id=64985011-9401-40a4-942c-751feb513bc1) from target:iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] detach volume v_801a03bc-1610-4d68-b2ad-aed2ea648885 from target iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885/luns/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885/luns/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885/luns/v_801a03bc-1610-4d68-b2ad-aed2ea648885'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885/luns/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] failed to remove resource iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 because of JDSS resource v_801a03bc-1610-4d68-b2ad-aed2ea648885 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] delete target: iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] delete target iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] failed to remove resource iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 because of JDSS resource iqn.2010-10.org.openstack:801a03bc-1610-4d68-b2ad-aed2ea648885 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] deleating volume v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] get snapshots for volume v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] get volume v_801a03bc-1610-4d68-b2ad-aed2ea648885 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_801a03bc-1610-4d68-b2ad-aed2ea648885', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447852', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115524', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7552625383726566857', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '81015a6f49a387a2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226532352', 'san:volume_id': '81015a6f49a387a2cefcfa4192dcae4d5fd058dc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89252', 'name': 'v_801a03bc-1610-4d68-b2ad-aed2ea648885', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] delete volume:v_801a03bc-1610-4d68-b2ad-aed2ea648885 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] atach volume v_9cdf2c58-c295-483e-b766-13e01129ede2 to target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3661646666666433', 'lun': 0, 'mode': 'wt', 'name': 'v_9cdf2c58-c295-483e-b766-13e01129ede2', 'prod_id': 'Storage', 'scsi_id': '6adfffd359b42273'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] add credentails to target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_801a03bc-1610-4d68-b2ad-aed2ea648885 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] volume v_801a03bc-1610-4d68-b2ad-aed2ea648885 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.quota [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Created reservations ['844591b2-d4f5-4f2a-b8ce-aab429cdc5a4'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:27:35 user cinder-volume[73393]: WARNING cinder.quota [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-559143218 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-559143218, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'name': 'MjAZDWGc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] initialize_connection for 9cdf2c58-c295-483e-b766-13e01129ede2 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.quota [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Created reservations ['99e1f11e-1594-48b1-a5a4-905e540e03aa', '6a94e52c-dabf-40d7-b12c-857e22bc06d5', 'd753aa1c-9331-4b4f-989b-1ac1a95c46ea', 'b697d860-16a8-4b70-bca9-4080b47a4c16'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MjAZDWGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '62991587-6529-4cf6-9702-0ab7621d58ca'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:27:35 user cinder-volume[73393]: INFO cinder.volume.manager [req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da req-46d0d97c-09ed-40fe-baac-35e263fa4af0 tempest-ServerActionsTestJSON-1048786641 None] attachment_update completed successfully. Apr 14 04:27:35 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=25,cinder:SELECT=69,cinder:DELETE=1,cinder:INSERT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226614272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:27:36 user cinder-volume[73393]: DEBUG cinder.manager [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:27:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-521743ab-6ee8-4717-ab79-b034386a9978 tempest-GroupSnapshotsV319Test-1512721632 None] Delete group completed successfully. Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Flow 'volume_create_manager' (574641cc-6762-4783-af5d-a31a1100791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0ab8da-5d84-488f-9830-07e432d27ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0ab8da-5d84-488f-9830-07e432d27ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2076123898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4542372c-b8e0-463f-8a78-0d1fb1a275f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312ec0442631483f93a0f6ab372818c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:27:41Z,use_quota=True,user_id='0cb4a776d9504695b8fe7acf66203910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(658b3874-d80c-4834-a15d-e7f39bbee736),volume_type_id=658b3874-d80c-4834-a15d-e7f39bbee736)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af699423-f7b6-4637-9fb5-23bdf877545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af699423-f7b6-4637-9fb5-23bdf877545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd592e0-41cc-4c0f-950f-c907a02cce2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd592e0-41cc-4c0f-950f-c907a02cce2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'volume_name': 'volume-4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e54627-4c5b-478d-a318-b1326d5418a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e54627-4c5b-478d-a318-b1326d5418a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9daabc9-ddd4-4933-baa3-8bf2c650e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:40 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Volume 4542372c-b8e0-463f-8a78-0d1fb1a275f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'volume_size': 1} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] creating volume v_4542372c-b8e0-463f-8a78-0d1fb1a275f2. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] create volume {'name': 'v_4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'is_clone': False, 'name': 'v_4542372c-b8e0-463f-8a78-0d1fb1a275f2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9daabc9-ddd4-4933-baa3-8bf2c650e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0faeec-f112-4349-9996-cfd0957f875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Volume volume-4542372c-b8e0-463f-8a78-0d1fb1a275f2 (4542372c-b8e0-463f-8a78-0d1fb1a275f2): created successfully Apr 14 04:27:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0faeec-f112-4349-9996-cfd0957f875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Flow 'volume_create_manager' (574641cc-6762-4783-af5d-a31a1100791a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:27:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f1f1ccd6-6598-4ea4-819e-7cc269ded110 tempest-VolumeTypesAccessTest-1823694152 None] Created volume successfully. Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Acquiring lock "cinder-4542372c-b8e0-463f-8a78-0d1fb1a275f2-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Lock "cinder-4542372c-b8e0-463f-8a78-0d1fb1a275f2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] remove_export for volume: 4542372c-b8e0-463f-8a78-0d1fb1a275f2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2076123898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4542372c-b8e0-463f-8a78-0d1fb1a275f2,launched_at=2023-04-14T04:27:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312ec0442631483f93a0f6ab372818c1',provider_auth='CHAP HwADmsvJ 7nr0J8Azj1ixkB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:27:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:27:43Z,updated_at=2023-04-14T04:27:43Z,use_quota=True,user_id='0cb4a776d9504695b8fe7acf66203910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(658b3874-d80c-4834-a15d-e7f39bbee736),volume_type_id=658b3874-d80c-4834-a15d-e7f39bbee736) from target:iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] detach volume v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 from target iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2/luns/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2/luns/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2/luns/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2/luns/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] failed to remove resource iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 because of JDSS resource v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] delete target: iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] delete target iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] failed to remove resource iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 because of JDSS resource iqn.2010-10.org.openstack:4542372c-b8e0-463f-8a78-0d1fb1a275f2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] deleating volume v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] get snapshots for volume v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] get volume v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447870', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115543', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15991137326668695633', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '08bd6c6e2179fd86', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226507776', 'san:volume_id': '08bd6c6e2179fd86a6a2f56a9dd3eb35e41be4f5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87611', 'name': 'v_4542372c-b8e0-463f-8a78-0d1fb1a275f2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] delete volume:v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] volume v_4542372c-b8e0-463f-8a78-0d1fb1a275f2 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:27:45 user cinder-volume[73393]: WARNING cinder.quota [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-949427474 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-949427474, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:27:45 user cinder-volume[73393]: WARNING cinder.quota [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-949427474 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-949427474, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:27:45 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=68,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:45 user cinder-volume[73393]: DEBUG cinder.quota [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Created reservations ['7037879a-513e-4f28-8dac-59174518cec6', '730ec338-e280-4ce9-aa4d-1c5614c66372', 'cf3dd8f7-1bf8-414d-a699-f4aec2b94c82', '28d8c9c4-f744-4250-8443-0d2955b3f11d'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:27:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:27:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:27:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226589696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:27:46 user cinder-volume[73393]: DEBUG cinder.manager [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:27:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Deleted volume successfully. Apr 14 04:27:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-00defd4c-d352-44ed-8e56-e519f94c615d tempest-VolumeTypesAccessTest-1823694152 None] Lock "cinder-4542372c-b8e0-463f-8a78-0d1fb1a275f2-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (a6692610-1331-4056-8350-48d2b6df76d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d808056d-c1e1-47cf-97bb-4b994e07e018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d808056d-c1e1-47cf-97bb-4b994e07e018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-850938353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=babb4943-f427-4d60-8c85-091fdae699ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebfb94ca-56aa-463a-aa4c-b5ad41138884,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:27:53Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7233ffad-93b4-491b-a239-c34a721ca695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7233ffad-93b4-491b-a239-c34a721ca695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4a2170-efcc-45e0-bd80-2c7c5ad98b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4a2170-efcc-45e0-bd80-2c7c5ad98b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'babb4943-f427-4d60-8c85-091fdae699ee', 'volume_name': 'volume-babb4943-f427-4d60-8c85-091fdae699ee', 'volume_size': 1, 'snapshot_id': 'ebfb94ca-56aa-463a-aa4c-b5ad41138884'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e6183d-dc5f-4e4c-a6d0-a11565dcffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e6183d-dc5f-4e4c-a6d0-a11565dcffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4c61ea-dc3a-4e21-a9fd-92b3e361f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:53 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Volume babb4943-f427-4d60-8c85-091fdae699ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-babb4943-f427-4d60-8c85-091fdae699ee', 'volume_size': 1, 'snapshot_id': 'ebfb94ca-56aa-463a-aa4c-b5ad41138884'} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] create volume babb4943-f427-4d60-8c85-091fdae699ee from snapshot ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] cloning s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 to v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] create export for volume: b9113785-28aa-46da-ae7d-d2f2e9a011b2. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] ensure volume b9113785-28aa-46da-ae7d-d2f2e9a011b2 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] check if targe iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] create target and attach volume b9113785-28aa-46da-ae7d-d2f2e9a011b2 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] create target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_babb4943-f427-4d60-8c85-091fdae699ee'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] create volume v_babb4943-f427-4d60-8c85-091fdae699ee from snapshot v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] terminate connection for d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:27:54 user cinder-volume[73393]: INFO cinder.volume.manager [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Terminate volume connection completed successfully. Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Deleting attachment 9c3f0ff7-d8ee-47ff-b86d-78661c6187a1. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] remove_export for volume: d8f57c49-602f-450f-8b9e-69f1f0255cee. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1471656916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8f57c49-602f-450f-8b9e-69f1f0255cee,launched_at=2023-04-14T04:25:44Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0a60f60717b44f4ba904a949eabfe608',provider_auth='CHAP HfrLsjmV N0RALYazrfU5gZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:42Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:27:54Z,use_quota=True,user_id='982f167333954612a51911fc8d6c1ce9',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] detach volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee from target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884@v_babb4943-f427-4d60-8c85-091fdae699ee', 'is_clone': True, 'full_name': 'Pool-0/v_babb4943-f427-4d60-8c85-091fdae699ee', 'name': 'v_babb4943-f427-4d60-8c85-091fdae699ee'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] get volume v_babb4943-f427-4d60-8c85-091fdae699ee info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:27:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] terminate connection for 24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:27:56 user cinder-volume[73393]: INFO cinder.volume.manager [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Terminate volume connection completed successfully. Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Deleting attachment ea1f39d1-7b26-4825-bff6-cb389473233a. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 24291e20-0b7c-4b2c-9351-0e6cd072508f. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=24291e20-0b7c-4b2c-9351-0e6cd072508f,launched_at=2023-04-14T04:26:07Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP PxcrKdyl WFHqawR0B1guCM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:04Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=1a977934-32df-4abc-b8da-83e57587448a,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:26:16Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] detach volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f from target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] delete target: iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] delete target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884@v_babb4943-f427-4d60-8c85-091fdae699ee', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_babb4943-f427-4d60-8c85-091fdae699ee', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447883', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '115551', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6379639068045532125', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '953582ffe51d589d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226577408', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89262', 'name': 'v_babb4943-f427-4d60-8c85-091fdae699ee', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4c61ea-dc3a-4e21-a9fd-92b3e361f154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babb4943-f427-4d60-8c85-091fdae699ee', 'volume_size': 1, 'snapshot_id': 'ebfb94ca-56aa-463a-aa4c-b5ad41138884'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fbd8c2-a98b-4100-a41c-256cab80a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:27:56 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Volume volume-babb4943-f427-4d60-8c85-091fdae699ee (babb4943-f427-4d60-8c85-091fdae699ee): created successfully Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fbd8c2-a98b-4100-a41c-256cab80a874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (a6692610-1331-4056-8350-48d2b6df76d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:27:56 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a8177ca4-cf14-4fcd-b757-c076673e8323 tempest-SnapshotDataIntegrityTests-502963555 None] Created volume successfully. Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 req-53300dce-6a36-48df-bea7-7d8edacccc6a tempest-TestMinimumBasicScenario-1872250892 None] target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] atach volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 to target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-8b105c6a-808f-4990-bf9c-b3a4056ff47d tempest-TestVolumeBootPattern-1780160917 None] target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.coordination [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-24291e20-0b7c-4b2c-9351-0e6cd072508f-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.coordination [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-24291e20-0b7c-4b2c-9351-0e6cd072508f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 24291e20-0b7c-4b2c-9351-0e6cd072508f. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=24291e20-0b7c-4b2c-9351-0e6cd072508f,launched_at=2023-04-14T04:26:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP PxcrKdyl WFHqawR0B1guCM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:04Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=1a977934-32df-4abc-b8da-83e57587448a,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:27:57Z,updated_at=2023-04-14T04:27:57Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f from target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns/v_24291e20-0b7c-4b2c-9351-0e6cd072508f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f/luns/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f because of JDSS resource v_24291e20-0b7c-4b2c-9351-0e6cd072508f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f because of JDSS resource iqn.2010-10.org.openstack:24291e20-0b7c-4b2c-9351-0e6cd072508f DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] deleating volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] create export for volume: babb4943-f427-4d60-8c85-091fdae699ee. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] ensure volume babb4943-f427-4d60-8c85-091fdae699ee assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] check if targe iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] create target and attach volume babb4943-f427-4d60-8c85-091fdae699ee to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] create target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] get volume v_24291e20-0b7c-4b2c-9351-0e6cd072508f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_1a977934-32df-4abc-b8da-83e57587448a@v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447774', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '115457', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14260167242456241079', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10125312', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': 'bea937730033076b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226552832', 'san:volume_id': 'bea937730033076b0b1472fdf74b74988e18865a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10125312', 'objsetid': '88361', 'name': 'v_24291e20-0b7c-4b2c-9351-0e6cd072508f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10125312', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] delete snapshot v_24291e20-0b7c-4b2c-9351-0e6cd072508f of volume s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3636313935613536', 'lun': 0, 'mode': 'wt', 'name': 'v_b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'prod_id': 'Storage', 'scsi_id': '66195a564a7e16f0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] add credentails to target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:27:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'name': 'IWZgAHoj'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] initialize_connection for b9113785-28aa-46da-ae7d-d2f2e9a011b2 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:27:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWZgAHoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0f1d889c-5759-4004-a6ca-b682af8b390f'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:27:58 user cinder-volume[73393]: INFO cinder.volume.manager [req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 req-503b0978-4b88-4205-bae9-010cc041735c tempest-VolumesSnapshotTestJSON-1226436274 None] attachment_update completed successfully. Apr 14 04:27:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots/v_24291e20-0b7c-4b2c-9351-0e6cd072508f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:27:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] snapshot v_24291e20-0b7c-4b2c-9351-0e6cd072508f deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:27:59 user cinder-volume[73393]: DEBUG cinder.quota [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['fc64e066-c2b7-4047-a05d-4b035a344035', 'c15f5338-d549-454e-a9fa-0c09947d71c8', 'eee5dcc9-0f6f-400c-953c-dcd7e3f0fc07', '309a6ee1-105a-4da5-ba30-f4df2f867a62'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:27:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:27:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:27:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:27:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'available': '114236727296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.manager [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:28:00 user cinder-volume[73393]: INFO cinder.volume.manager [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Deleted volume successfully. Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.coordination [req-c7c48dc7-3212-4b47-9372-14dd06b974f2 req-39f9f76f-deec-4ef0-9072-a6c74c181283 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-24291e20-0b7c-4b2c-9351-0e6cd072508f-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] atach volume v_babb4943-f427-4d60-8c85-091fdae699ee to target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot dac42c2e-3e3f-4f72-b58b-05bd90e63ced for volume b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 to s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3935333538326666', 'lun': 0, 'mode': 'wt', 'name': 'v_babb4943-f427-4d60-8c85-091fdae699ee', 'prod_id': 'Storage', 'scsi_id': '953582ffe51d589d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] add credentails to target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'name': 'wXCvrjzG'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] initialize_connection for babb4943-f427-4d60-8c85-091fdae699ee 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:28:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXCvrjzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e018d31b-6aa2-4a57-a91f-3b5c58c9a342'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:28:02 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=67,cinder:UPDATE=28,cinder:INSERT=3,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:02 user cinder-volume[73393]: INFO cinder.volume.manager [req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 req-de3e02e2-21ab-40b4-bc39-7746e79c5511 tempest-SnapshotDataIntegrityTests-502963555 None] attachment_update completed successfully. Apr 14 04:28:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_dac42c2e-3e3f-4f72-b58b-05bd90e63ced'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced from snapshot s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:28:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced', 'is_clone': True, 'full_name': 'Pool-0/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced', 'name': 's_dac42c2e-3e3f-4f72-b58b-05bd90e63ced'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:28:03 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7b08f5d3-da4b-4887-b64e-49c7f03f6659 tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:28:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot 61d44fcc-6220-4e83-a778-3e924ae4a4d1 for volume b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:28:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 to s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:28:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:28:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_61d44fcc-6220-4e83-a778-3e924ae4a4d1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 from snapshot s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:28:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] terminate connection for babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:28:06 user cinder-volume[73393]: INFO cinder.volume.manager [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Terminate volume connection completed successfully. Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Deleting attachment e018d31b-6aa2-4a57-a91f-3b5c58c9a342. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: babb4943-f427-4d60-8c85-091fdae699ee. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-850938353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=babb4943-f427-4d60-8c85-091fdae699ee,launched_at=2023-04-14T04:27:56Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP wXCvrjzG uq98UWFmvQz1Kf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:27:53Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=ebfb94ca-56aa-463a-aa4c-b5ad41138884,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:28:05Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_babb4943-f427-4d60-8c85-091fdae699ee from target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_61d44fcc-6220-4e83-a778-3e924ae4a4d1', 'is_clone': True, 'full_name': 'Pool-0/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1', 'name': 's_61d44fcc-6220-4e83-a778-3e924ae4a4d1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:28:06 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1207da99-a200-4e5e-8bc2-46ac425e71bc tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 req-a65d8223-7d7b-4166-9a6d-abb0d32dbac2 tempest-SnapshotDataIntegrityTests-502963555 None] target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-61d44fcc-6220-4e83-a778-3e924ae4a4d1-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-61d44fcc-6220-4e83-a778-3e924ae4a4d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_61d44fcc-6220-4e83-a778-3e924ae4a4d1. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_61d44fcc-6220-4e83-a778-3e924ae4a4d1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447894', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115578', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3797593637047219842', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '091111bb7b318727', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236559360', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88258', 'name': 's_61d44fcc-6220-4e83-a778-3e924ae4a4d1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 of volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_61d44fcc-6220-4e83-a778-3e924ae4a4d1 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.quota [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['9bff3907-f789-47e7-8e9e-5f3c3fa26261', '72513184-c32f-4ca0-8fae-aad7b6ed8df4', 'ed545c52-8445-4180-a2a4-ac6bc269b5bf', '385e9981-55f3-41be-8d03-3632c15b9ff0'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=68,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a891e69c-7e25-4aa6-9885-87a15e9bb1a7 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-61d44fcc-6220-4e83-a778-3e924ae4a4d1-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-ac32b119-4698-40d3-8e49-8021d43b62f7-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-ac32b119-4698-40d3-8e49-8021d43b62f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_ac32b119-4698-40d3-8e49-8021d43b62f7. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_ac32b119-4698-40d3-8e49-8021d43b62f7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_ac32b119-4698-40d3-8e49-8021d43b62f7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ac32b119-4698-40d3-8e49-8021d43b62f7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447768', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115446', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12070376726153328297', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a2068f3ea4df9da3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236596224', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89490', 'name': 's_ac32b119-4698-40d3-8e49-8021d43b62f7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_ac32b119-4698-40d3-8e49-8021d43b62f7 of volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_ac32b119-4698-40d3-8e49-8021d43b62f7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_ac32b119-4698-40d3-8e49-8021d43b62f7 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:28:13 user cinder-volume[73393]: DEBUG cinder.quota [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['26f191bd-df28-4c32-9551-6fca0ed9cb16', '1e06574e-d617-4ec2-9c67-8e46d698efcf', '7a042931-4534-4a3d-8b0c-f97c8122f884', '41acc81a-5243-415f-a185-13b7284f08fc'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:28:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:28:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d6705103-866e-4754-90d7-29cbc0c06a08 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-ac32b119-4698-40d3-8e49-8021d43b62f7-delete_snapshot" released by "delete_snapshot" :: held 2.465s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] terminate connection for bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:28:14 user cinder-volume[73393]: INFO cinder.volume.manager [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Terminate volume connection completed successfully. Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Deleting attachment bf5d96e9-8dbd-4ab4-97b5-3681b55419a4. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] remove_export for volume: bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1698950194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bcb3b184-a10d-482d-8c49-1bee42873be4,launched_at=2023-04-14T04:26:16Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='b0e15d3d3e0943c4b6bd54abf2de5fee',provider_auth='CHAP pRhHtNJB tTvXaVnGJhZjzF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:26:27Z,use_quota=True,user_id='36b6981092424de781e8403946f956d3',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] detach volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 from target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-dac42c2e-3e3f-4f72-b58b-05bd90e63ced-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-dac42c2e-3e3f-4f72-b58b-05bd90e63ced-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] delete target: iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] delete target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2@s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447891', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115571', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16126120996351180311', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c9fda17e90bc2866', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236604416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89282', 'name': 's_dac42c2e-3e3f-4f72-b58b-05bd90e63ced', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced of volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4f707de-ae1c-47af-8554-49fd3aefd32b req-92f7ef10-0920-4a7f-ad19-5589ade8740a tempest-TestShelveInstance-1458140851 None] target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:28:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots/s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_dac42c2e-3e3f-4f72-b58b-05bd90e63ced deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:28:16 user cinder-volume[73393]: DEBUG cinder.quota [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['67a59d0d-0c11-463b-b72d-50d866fc7f7f', 'eb87536f-d0d5-4b39-96ba-c7c7d8855991', 'a97d0cb9-174a-46ba-8f72-f6fdc67d0f77', 'c2989252-47c1-423c-a6d0-3668ff49b6c4'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:28:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:28:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-75a7e091-c0e8-46ee-9e89-a433917455d4 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-dac42c2e-3e3f-4f72-b58b-05bd90e63ced-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] terminate connection for b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:28:18 user cinder-volume[73393]: INFO cinder.volume.manager [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Terminate volume connection completed successfully. Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Deleting attachment 0f1d889c-5759-4004-a6ca-b682af8b390f. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: b9113785-28aa-46da-ae7d-d2f2e9a011b2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-813561633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9113785-28aa-46da-ae7d-d2f2e9a011b2,launched_at=2023-04-14T04:22:29Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP IWZgAHoj Oejg2LTE8iNlwR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:28:18Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 from target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 req-3c4c417e-919e-4c06-8f92-abd7b56cdcf8 tempest-VolumesSnapshotTestJSON-1226436274 None] target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:28:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:28:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:28:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:28:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114236628992', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:28:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:28:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=42,cinder:UPDATE=23,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-1a977934-32df-4abc-b8da-83e57587448a-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-1a977934-32df-4abc-b8da-83e57587448a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] deleating snapshot s_1a977934-32df-4abc-b8da-83e57587448a. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Acquiring lock "cinder-d8f57c49-602f-450f-8b9e-69f1f0255cee-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Lock "cinder-d8f57c49-602f-450f-8b9e-69f1f0255cee-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=13,cinder:SELECT=32,cinder:INSERT=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] remove_export for volume: d8f57c49-602f-450f-8b9e-69f1f0255cee. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1471656916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8f57c49-602f-450f-8b9e-69f1f0255cee,launched_at=2023-04-14T04:25:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a60f60717b44f4ba904a949eabfe608',provider_auth='CHAP HfrLsjmV N0RALYazrfU5gZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:42Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:28:44Z,updated_at=2023-04-14T04:28:44Z,use_quota=True,user_id='982f167333954612a51911fc8d6c1ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] detach volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee from target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns/v_d8f57c49-602f-450f-8b9e-69f1f0255cee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee/luns/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] failed to remove resource iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee because of JDSS resource v_d8f57c49-602f-450f-8b9e-69f1f0255cee DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] delete target: iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] delete target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] failed to remove resource iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee because of JDSS resource iqn.2010-10.org.openstack:d8f57c49-602f-450f-8b9e-69f1f0255cee DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] deleating volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] get snapshots for volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] get volume s_1a977934-32df-4abc-b8da-83e57587448a info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_82554171-f944-4021-b0b4-09e74236c22d@s_1a977934-32df-4abc-b8da-83e57587448a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_1a977934-32df-4abc-b8da-83e57587448a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447767', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115442', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12595496925057710443', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dddc0c8cd91da540', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236628992', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89478', 'name': 's_1a977934-32df-4abc-b8da-83e57587448a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] delete snapshot s_1a977934-32df-4abc-b8da-83e57587448a of volume v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots/s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots/s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] get volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d8f57c49-602f-450f-8b9e-69f1f0255cee', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447751', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115384', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '79313961852835970', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '747f468ec93ea564', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236604416', 'san:volume_id': '747f468ec93ea564e1beeb340296590c97cafa08', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88769', 'name': 'v_d8f57c49-602f-450f-8b9e-69f1f0255cee', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] delete volume:v_d8f57c49-602f-450f-8b9e-69f1f0255cee recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots/s_1a977934-32df-4abc-b8da-83e57587448a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] snapshot s_1a977934-32df-4abc-b8da-83e57587448a deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.quota [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['d402dda1-c13d-4512-a4e4-ff48c68b1790', '752e7f95-20e8-449f-9844-b589ae5a3812', '469a4acd-1fe6-4fcd-8f06-c60d3275c730', 'bc6480a8-6a26-4900-af1b-60856ca10e11'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:28:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Delete snapshot completed successfully. Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5705b674-e922-417f-a634-b27438245dd3 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-1a977934-32df-4abc-b8da-83e57587448a-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] volume v_d8f57c49-602f-450f-8b9e-69f1f0255cee deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.quota [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Created reservations ['41c3632a-1076-46f4-b695-76b0bd1c725c', '6cce6ece-98ab-4b41-809f-d64fe05c3f63', 'dac42924-d2d6-4a70-83fe-c346cab79c54', 'bd69493d-1316-409e-ab8c-c3d001dd8a0a'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Geting {'code': 200, 'error': None, 'data': {'available': '114236723200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.manager [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:28:47 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Deleted volume successfully. Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-82554171-f944-4021-b0b4-09e74236c22d-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8aa6c912-c954-4474-827d-f766018e16e0 tempest-TestMinimumBasicScenario-1872250892 None] Lock "cinder-d8f57c49-602f-450f-8b9e-69f1f0255cee-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-82554171-f944-4021-b0b4-09e74236c22d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 82554171-f944-4021-b0b4-09e74236c22d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1802551281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=82554171-f944-4021-b0b4-09e74236c22d,launched_at=2023-04-14T04:25:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP GoiQNyvf IrmFEOQq4lYxw7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:28:47Z,updated_at=2023-04-14T04:28:47Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] detach volume v_82554171-f944-4021-b0b4-09e74236c22d from target iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d/luns/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d/luns/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d/luns/v_82554171-f944-4021-b0b4-09e74236c22d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d/luns/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d because of JDSS resource v_82554171-f944-4021-b0b4-09e74236c22d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d because of JDSS resource iqn.2010-10.org.openstack:82554171-f944-4021-b0b4-09e74236c22d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] deleating volume v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] get volume v_82554171-f944-4021-b0b4-09e74236c22d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_82554171-f944-4021-b0b4-09e74236c22d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_82554171-f944-4021-b0b4-09e74236c22d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447764', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115425', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '717590863778262062', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c0556ee4041247dc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236723200', 'san:volume_id': 'c0556ee4041247dc2141db710bcc6082541b55b0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88856', 'name': 'v_82554171-f944-4021-b0b4-09e74236c22d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] delete snapshot v_82554171-f944-4021-b0b4-09e74236c22d of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Flow 'volume_create_manager' (b8cf2222-a2a6-4fde-a299-9678df63049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fc14c5-f249-425e-be8e-0e32f12c0d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fc14c5-f249-425e-be8e-0e32f12c0d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221184690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e11df2cb-b474-4faf-afdf-a1c4e7d905ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:28:48Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaabe0a-d86d-4094-8107-e027be137374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaabe0a-d86d-4094-8107-e027be137374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1549c7-4f6e-4292-8e9c-755b014fcc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1549c7-4f6e-4292-8e9c-755b014fcc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'volume_name': 'volume-e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf83a7f6-45f5-4d91-897a-cb964395c118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf83a7f6-45f5-4d91-897a-cb964395c118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce73ad2-52c7-4090-b83e-cbaa50be1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:48 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Volume e11df2cb-b474-4faf-afdf-a1c4e7d905ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'volume_size': 1} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] creating volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] create volume {'name': 'v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_82554171-f944-4021-b0b4-09e74236c22d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] snapshot v_82554171-f944-4021-b0b4-09e74236c22d deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.quota [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['8fe7af29-8c09-4e7f-bda6-75395eeb8b14', '8f6fdd06-f2b0-484a-a0ea-e5a35233545f', 'b964396f-9988-4ef2-99b0-9bfb006385bc', 'c1a0c091-9bed-44a1-bb0c-a0d9c88bd580'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'is_clone': False, 'name': 'v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce73ad2-52c7-4090-b83e-cbaa50be1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b33f2f-56d3-4b46-adb2-03894480931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:49 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Volume volume-e11df2cb-b474-4faf-afdf-a1c4e7d905ad (e11df2cb-b474-4faf-afdf-a1c4e7d905ad): created successfully Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b33f2f-56d3-4b46-adb2-03894480931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Flow 'volume_create_manager' (b8cf2222-a2a6-4fde-a299-9678df63049f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:28:49 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6f9139fb-aeaf-412a-ac7e-52714acc3182 tempest-AttachVolumeTestJSON-991906288 None] Created volume successfully. Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'available': '114236653568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.manager [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:28:50 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Deleted volume successfully. Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b9a98b08-eda4-4eeb-81a8-8b5d4fbe4ece tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-82554171-f944-4021-b0b4-09e74236c22d-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (1a2df4b5-71dd-4426-8fc4-277cca9d2983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716ebd0f-2f09-42a3-b212-12934f50dcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716ebd0f-2f09-42a3-b212-12934f50dcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1148171054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=300999d2-cadf-4299-8a05-85dec6b7d895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:28:51Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1bdca5-7221-4c33-a785-79c47da424af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1bdca5-7221-4c33-a785-79c47da424af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83edaf68-3b56-4ba3-8d42-192b591096d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83edaf68-3b56-4ba3-8d42-192b591096d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '300999d2-cadf-4299-8a05-85dec6b7d895', 'volume_name': 'volume-300999d2-cadf-4299-8a05-85dec6b7d895', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c7c137-aad4-44a2-83d6-b743e572c0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c7c137-aad4-44a2-83d6-b743e572c0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad744d2-0bb2-4e5d-a484-28d984fbbe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:51 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Volume 300999d2-cadf-4299-8a05-85dec6b7d895: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-300999d2-cadf-4299-8a05-85dec6b7d895', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Cloning 300999d2-cadf-4299-8a05-85dec6b7d895 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 28, 51, 92840)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 28, 51, 105302)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] create snapshot v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] create export for volume: e11df2cb-b474-4faf-afdf-a1c4e7d905ad. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] ensure volume e11df2cb-b474-4faf-afdf-a1c4e7d905ad assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] check if targe iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] create target and attach volume e11df2cb-b474-4faf-afdf-a1c4e7d905ad to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] create target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_300999d2-cadf-4299-8a05-85dec6b7d895'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] create volume v_300999d2-cadf-4299-8a05-85dec6b7d895 from snapshot v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:28:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_300999d2-cadf-4299-8a05-85dec6b7d895', 'is_clone': True, 'full_name': 'Pool-0/v_300999d2-cadf-4299-8a05-85dec6b7d895', 'name': 'v_300999d2-cadf-4299-8a05-85dec6b7d895'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] get volume v_300999d2-cadf-4299-8a05-85dec6b7d895 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_300999d2-cadf-4299-8a05-85dec6b7d895', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_300999d2-cadf-4299-8a05-85dec6b7d895', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447941', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115620', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2500258779471554768', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '91e4550fdbd1076d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236628992', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88411', 'name': 'v_300999d2-cadf-4299-8a05-85dec6b7d895', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Marking volume 300999d2-cadf-4299-8a05-85dec6b7d895 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 300999d2-cadf-4299-8a05-85dec6b7d895. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Creating volume glance metadata for volume 300999d2-cadf-4299-8a05-85dec6b7d895 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad744d2-0bb2-4e5d-a484-28d984fbbe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300999d2-cadf-4299-8a05-85dec6b7d895', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13deaa9-6f5f-462c-8cd7-f3732aed38a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:53 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Volume volume-300999d2-cadf-4299-8a05-85dec6b7d895 (300999d2-cadf-4299-8a05-85dec6b7d895): created successfully Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13deaa9-6f5f-462c-8cd7-f3732aed38a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (1a2df4b5-71dd-4426-8fc4-277cca9d2983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:28:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2bc6f626-664e-4564-b998-940432bf1b88 tempest-TestVolumeBootPattern-1780160917 None] Created volume successfully. Apr 14 04:28:53 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:INSERT=14,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] atach volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad to target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3439393331376166', 'lun': 0, 'mode': 'wt', 'name': 'v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'prod_id': 'Storage', 'scsi_id': '499317af467792d3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] add credentails to target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'name': 'rETDPxvm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] initialize_connection for e11df2cb-b474-4faf-afdf-a1c4e7d905ad 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rETDPxvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '94406c52-cd69-4979-a2de-dea06283c6b6'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:28:55 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:UPDATE=30,cinder:INSERT=10,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:55 user cinder-volume[73393]: INFO cinder.volume.manager [req-9998eb89-ab73-4040-8321-89ceb17dde8e req-4da59a8f-74b7-455a-bd80-56d60079bf89 tempest-AttachVolumeTestJSON-991906288 None] attachment_update completed successfully. Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (ada44eae-25bf-44c2-a117-5b9d4f9de916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556bcb73-a552-47b1-8d35-da5e40fa53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556bcb73-a552-47b1-8d35-da5e40fa53ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1106199434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=90c1922d-91ec-49ff-8993-980caa04a670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5dab436b-0543-4a34-92eb-ba093c0be7b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:28:56Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2781d55-5ec9-4427-8579-875cf56c5469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2781d55-5ec9-4427-8579-875cf56c5469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e3d869-4c1c-4d25-aa3c-20e4c1a2c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e3d869-4c1c-4d25-aa3c-20e4c1a2c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90c1922d-91ec-49ff-8993-980caa04a670', 'volume_name': 'volume-90c1922d-91ec-49ff-8993-980caa04a670', 'volume_size': 1, 'snapshot_id': '5dab436b-0543-4a34-92eb-ba093c0be7b0'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb90f857-dc55-4245-92b1-5fbe269cbbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb90f857-dc55-4245-92b1-5fbe269cbbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0825f7b-daee-49f8-9e8c-7239c61d7fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:56 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Volume 90c1922d-91ec-49ff-8993-980caa04a670: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90c1922d-91ec-49ff-8993-980caa04a670', 'volume_size': 1, 'snapshot_id': '5dab436b-0543-4a34-92eb-ba093c0be7b0'} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] create volume 90c1922d-91ec-49ff-8993-980caa04a670 from snapshot 5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] cloning s_5dab436b-0543-4a34-92eb-ba093c0be7b0 to v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] create snapshot v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] create export for volume: 300999d2-cadf-4299-8a05-85dec6b7d895. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] ensure volume 300999d2-cadf-4299-8a05-85dec6b7d895 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] check if targe iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] create target and attach volume 300999d2-cadf-4299-8a05-85dec6b7d895 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] create target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_90c1922d-91ec-49ff-8993-980caa04a670'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] create volume v_90c1922d-91ec-49ff-8993-980caa04a670 from snapshot v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:28:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5dab436b-0543-4a34-92eb-ba093c0be7b0@v_90c1922d-91ec-49ff-8993-980caa04a670', 'is_clone': True, 'full_name': 'Pool-0/v_90c1922d-91ec-49ff-8993-980caa04a670', 'name': 'v_90c1922d-91ec-49ff-8993-980caa04a670'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] get volume v_90c1922d-91ec-49ff-8993-980caa04a670 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5dab436b-0543-4a34-92eb-ba093c0be7b0@v_90c1922d-91ec-49ff-8993-980caa04a670', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_90c1922d-91ec-49ff-8993-980caa04a670', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447946', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '115630', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17589410147304735183', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8ecf64691c903ec1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236592128', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88786', 'name': 'v_90c1922d-91ec-49ff-8993-980caa04a670', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0825f7b-daee-49f8-9e8c-7239c61d7fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c1922d-91ec-49ff-8993-980caa04a670', 'volume_size': 1, 'snapshot_id': '5dab436b-0543-4a34-92eb-ba093c0be7b0'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01badfa8-3cd8-4962-8208-75f4bf75257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:58 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Volume volume-90c1922d-91ec-49ff-8993-980caa04a670 (90c1922d-91ec-49ff-8993-980caa04a670): created successfully Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01badfa8-3cd8-4962-8208-75f4bf75257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Flow 'volume_create_manager' (ada44eae-25bf-44c2-a117-5b9d4f9de916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:28:58 user cinder-volume[73393]: INFO cinder.volume.manager [None req-93077066-8c44-4c85-a560-0f4fd62f0121 tempest-SnapshotDataIntegrityTests-502963555 None] Created volume successfully. Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Flow 'volume_create_manager' (9ec1aa25-678b-4802-a854-6fecaedb423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65689c0-4ec2-427b-9c70-a4771c6b15ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65689c0-4ec2-427b-9c70-a4771c6b15ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569246463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=43b7dada-23d8-4db0-9be7-b0fff3287b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:28:59Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa7eb32-d6f4-4ecb-9d70-19e46ee7ac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa7eb32-d6f4-4ecb-9d70-19e46ee7ac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baded505-2d78-4581-8368-e2d945c86b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baded505-2d78-4581-8368-e2d945c86b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b7dada-23d8-4db0-9be7-b0fff3287b15', 'volume_name': 'volume-43b7dada-23d8-4db0-9be7-b0fff3287b15', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce287e6-c5fd-4b7c-b688-2dc349724a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce287e6-c5fd-4b7c-b688-2dc349724a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19c8c99-ad0a-4e9b-b5eb-3d7fe19aa277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:28:58 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Volume 43b7dada-23d8-4db0-9be7-b0fff3287b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b7dada-23d8-4db0-9be7-b0fff3287b15', 'volume_size': 1} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] creating volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] create volume {'name': 'v_43b7dada-23d8-4db0-9be7-b0fff3287b15', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:28:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:28:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] atach volume v_300999d2-cadf-4299-8a05-85dec6b7d895 to target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:28:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:28:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_43b7dada-23d8-4db0-9be7-b0fff3287b15', 'is_clone': False, 'name': 'v_43b7dada-23d8-4db0-9be7-b0fff3287b15'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19c8c99-ad0a-4e9b-b5eb-3d7fe19aa277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b7dada-23d8-4db0-9be7-b0fff3287b15', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c1cec0-64f3-49a2-88c3-f17efc7499e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] create export for volume: 90c1922d-91ec-49ff-8993-980caa04a670. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] ensure volume 90c1922d-91ec-49ff-8993-980caa04a670 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] check if targe iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] create target and attach volume 90c1922d-91ec-49ff-8993-980caa04a670 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] create target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:00 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Volume volume-43b7dada-23d8-4db0-9be7-b0fff3287b15 (43b7dada-23d8-4db0-9be7-b0fff3287b15): created successfully Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c1cec0-64f3-49a2-88c3-f17efc7499e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Flow 'volume_create_manager' (9ec1aa25-678b-4802-a854-6fecaedb423c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ce73de55-216d-47a0-8183-b2337159c078 tempest-AttachVolumeTestJSON-991906288 None] Created volume successfully. Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3931653435353066', 'lun': 0, 'mode': 'wt', 'name': 'v_300999d2-cadf-4299-8a05-85dec6b7d895', 'prod_id': 'Storage', 'scsi_id': '91e4550fdbd1076d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] add credentails to target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'name': 'myaLbCEo'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] initialize_connection for 300999d2-cadf-4299-8a05-85dec6b7d895 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myaLbCEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '380712c0-d593-4894-9e7c-53a4bc13bbe7'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:29:01 user cinder-volume[73393]: INFO cinder.volume.manager [req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 req-7bb38ded-a541-488b-afe0-6ae036db9ab1 tempest-TestVolumeBootPattern-1780160917 None] attachment_update completed successfully. Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] create export for volume: 43b7dada-23d8-4db0-9be7-b0fff3287b15. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] ensure volume 43b7dada-23d8-4db0-9be7-b0fff3287b15 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] check if targe iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] create target and attach volume 43b7dada-23d8-4db0-9be7-b0fff3287b15 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] create target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] atach volume v_90c1922d-91ec-49ff-8993-980caa04a670 to target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:29:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] atach volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15 to target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3865636636343639', 'lun': 0, 'mode': 'wt', 'name': 'v_90c1922d-91ec-49ff-8993-980caa04a670', 'prod_id': 'Storage', 'scsi_id': '8ecf64691c903ec1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] add credentails to target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 201, 'error': None, 'data': {'name': 'wAqINGHP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] initialize_connection for 90c1922d-91ec-49ff-8993-980caa04a670 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:29:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAqINGHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '31a1c42d-6a7c-46bc-8137-9fb1e07c987e'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:29:05 user cinder-volume[73393]: INFO cinder.volume.manager [req-04f34ad2-6881-4c9d-9898-a918ed540016 req-7705c0fc-21eb-4e04-b44b-aeaf1890e0e3 tempest-SnapshotDataIntegrityTests-502963555 None] attachment_update completed successfully. Apr 14 04:29:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6531333435666438', 'lun': 0, 'mode': 'wt', 'name': 'v_43b7dada-23d8-4db0-9be7-b0fff3287b15', 'prod_id': 'Storage', 'scsi_id': 'e1345fd8708a25e9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] add credentails to target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:29:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 201, 'error': None, 'data': {'name': 'BPQNykGu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] initialize_connection for 43b7dada-23d8-4db0-9be7-b0fff3287b15 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:29:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPQNykGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '7977ed42-2611-4e93-8fef-709adc21b4c3'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:29:06 user cinder-volume[73393]: INFO cinder.volume.manager [req-3b844cad-6161-4c3c-9e19-c0f4e265b84f req-1c4280ef-b781-4ec4-abc2-dbb212d3537f tempest-AttachVolumeTestJSON-991906288 None] attachment_update completed successfully. Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (2002c271-4d82-4b62-961a-ec9d476468cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffff2d13-4bd3-419a-b1ba-e0c9a59ad53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffff2d13-4bd3-419a-b1ba-e0c9a59ad53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1490175981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=887d7462-95a3-4b76-b25b-7d333e7704e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:29:08Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8830eb7d-b8cc-4b44-a744-518727d86b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8830eb7d-b8cc-4b44-a744-518727d86b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228de077-e7e4-4692-ba68-c3362300e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228de077-e7e4-4692-ba68-c3362300e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887d7462-95a3-4b76-b25b-7d333e7704e8', 'volume_name': 'volume-887d7462-95a3-4b76-b25b-7d333e7704e8', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e768a5-5c41-4634-b4c4-f649789af085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e768a5-5c41-4634-b4c4-f649789af085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3f48c2-55ac-40e8-b9dd-30c97e6a2c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:08 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume 887d7462-95a3-4b76-b25b-7d333e7704e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887d7462-95a3-4b76-b25b-7d333e7704e8', 'volume_size': 1} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] creating volume v_887d7462-95a3-4b76-b25b-7d333e7704e8. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume {'name': 'v_887d7462-95a3-4b76-b25b-7d333e7704e8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_887d7462-95a3-4b76-b25b-7d333e7704e8', 'is_clone': False, 'name': 'v_887d7462-95a3-4b76-b25b-7d333e7704e8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3f48c2-55ac-40e8-b9dd-30c97e6a2c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887d7462-95a3-4b76-b25b-7d333e7704e8', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d555ed12-efba-4e30-a991-2384914312be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:09 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume volume-887d7462-95a3-4b76-b25b-7d333e7704e8 (887d7462-95a3-4b76-b25b-7d333e7704e8): created successfully Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d555ed12-efba-4e30-a991-2384914312be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (2002c271-4d82-4b62-961a-ec9d476468cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:09 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f94d3661-df87-45cb-a5dc-a624d2517512 tempest-VolumesSnapshotTestJSON-1226436274 None] Created volume successfully. Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] terminate connection for 90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:29:09 user cinder-volume[73393]: INFO cinder.volume.manager [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Terminate volume connection completed successfully. Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Deleting attachment 31a1c42d-6a7c-46bc-8137-9fb1e07c987e. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: 90c1922d-91ec-49ff-8993-980caa04a670. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1106199434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=90c1922d-91ec-49ff-8993-980caa04a670,launched_at=2023-04-14T04:28:59Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP wAqINGHP b7IdZeqw8JOa5B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:56Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=5dab436b-0543-4a34-92eb-ba093c0be7b0,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:29:09Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_90c1922d-91ec-49ff-8993-980caa04a670 from target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot 917d2987-f244-484b-89ea-ed0ef85fc3bf for volume 887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_887d7462-95a3-4b76-b25b-7d333e7704e8 to s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d07c6827-353d-479e-ab45-80aa4c20784d req-dad7cfb1-91a8-4185-a010-36e214695cfd tempest-SnapshotDataIntegrityTests-502963555 None] target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] terminate connection for e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:29:10 user cinder-volume[73393]: INFO cinder.volume.manager [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Terminate volume connection completed successfully. Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Deleting attachment 94406c52-cd69-4979-a2de-dea06283c6b6. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] remove_export for volume: e11df2cb-b474-4faf-afdf-a1c4e7d905ad. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221184690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e11df2cb-b474-4faf-afdf-a1c4e7d905ad,launched_at=2023-04-14T04:28:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth='CHAP rETDPxvm DS2m0LgdV6P7tX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:48Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:29:10Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] detach volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad from target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] delete target: iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] delete target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c req-ac5c7262-7af8-465d-aaab-6b4af003cfbd tempest-AttachVolumeTestJSON-991906288 None] target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_917d2987-f244-484b-89ea-ed0ef85fc3bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_917d2987-f244-484b-89ea-ed0ef85fc3bf from snapshot s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_887d7462-95a3-4b76-b25b-7d333e7704e8@s_917d2987-f244-484b-89ea-ed0ef85fc3bf', 'is_clone': True, 'full_name': 'Pool-0/s_917d2987-f244-484b-89ea-ed0ef85fc3bf', 'name': 's_917d2987-f244-484b-89ea-ed0ef85fc3bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_917d2987-f244-484b-89ea-ed0ef85fc3bf properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:29:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ed3ecda7-6629-47f2-aae9-ae7761700663 tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] terminate connection for 43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:29:13 user cinder-volume[73393]: INFO cinder.volume.manager [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Terminate volume connection completed successfully. Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Deleting attachment 7977ed42-2611-4e93-8fef-709adc21b4c3. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] remove_export for volume: 43b7dada-23d8-4db0-9be7-b0fff3287b15. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569246463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=43b7dada-23d8-4db0-9be7-b0fff3287b15,launched_at=2023-04-14T04:29:00Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth='CHAP BPQNykGu kDBASTO9xYPV1F',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:59Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:29:12Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] detach volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15 from target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] delete target: iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] delete target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe req-786f90bd-0a43-4a75-8dd6-4eff87759058 tempest-AttachVolumeTestJSON-991906288 None] target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (695b34e2-e564-42d0-9bb3-4c7fa7f9240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fa7b34-8f97-4d78-95b2-bef5ac8400ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fa7b34-8f97-4d78-95b2-bef5ac8400ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-679682229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1a30ee4d-a4d7-4184-86c8-f72bbae0d90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=917d2987-f244-484b-89ea-ed0ef85fc3bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:29:14Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a504a5-44cf-48d7-9a40-7e41600fa78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a504a5-44cf-48d7-9a40-7e41600fa78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76fcdf9-8c84-4005-8bb4-30ea47d5e447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76fcdf9-8c84-4005-8bb4-30ea47d5e447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'volume_name': 'volume-1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'volume_size': 2, 'snapshot_id': '917d2987-f244-484b-89ea-ed0ef85fc3bf'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ec00d5-f7df-4673-bc45-d9310702d35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ec00d5-f7df-4673-bc45-d9310702d35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf1e70a-ed17-4408-ad89-99b4fdfbd84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:14 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume 1a30ee4d-a4d7-4184-86c8-f72bbae0d90e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'volume_size': 2, 'snapshot_id': '917d2987-f244-484b-89ea-ed0ef85fc3bf'} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume 1a30ee4d-a4d7-4184-86c8-f72bbae0d90e from snapshot 917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning s_917d2987-f244-484b-89ea-ed0ef85fc3bf to v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e from snapshot v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:29:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_917d2987-f244-484b-89ea-ed0ef85fc3bf@v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'is_clone': True, 'full_name': 'Pool-0/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'name': 'v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_917d2987-f244-484b-89ea-ed0ef85fc3bf@v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447964', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115667', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '186246856501395945', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '510f62b494e7bb5d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236235776', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89615', 'name': 'v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Extend volume 1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] jdss extend volume v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e to 2147483648 {{(pid=73393) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf1e70a-ed17-4408-ad89-99b4fdfbd84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'volume_size': 2, 'snapshot_id': '917d2987-f244-484b-89ea-ed0ef85fc3bf'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d64d68-b9c1-49b4-b9b8-88a426b89c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume volume-1a30ee4d-a4d7-4184-86c8-f72bbae0d90e (1a30ee4d-a4d7-4184-86c8-f72bbae0d90e): created successfully Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d64d68-b9c1-49b4-b9b8-88a426b89c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (695b34e2-e564-42d0-9bb3-4c7fa7f9240d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:17 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6a47e49d-99d5-4446-9337-63901f66dc51 tempest-VolumesSnapshotTestJSON-1226436274 None] Created volume successfully. Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-1a30ee4d-a4d7-4184-86c8-f72bbae0d90e-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-1a30ee4d-a4d7-4184-86c8-f72bbae0d90e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=82,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: 1a30ee4d-a4d7-4184-86c8-f72bbae0d90e. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-679682229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1a30ee4d-a4d7-4184-86c8-f72bbae0d90e,launched_at=2023-04-14T04:29:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP EjzGcTUB EoWwqbBmh91Zaf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=2,snapshot_id=917d2987-f244-484b-89ea-ed0ef85fc3bf,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:29:17Z,updated_at=2023-04-14T04:29:17Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e from target iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e/luns/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e/luns/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e/luns/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e/luns/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e because of JDSS resource v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e because of JDSS resource iqn.2010-10.org.openstack:1a30ee4d-a4d7-4184-86c8-f72bbae0d90e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] deleating volume v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_917d2987-f244-484b-89ea-ed0ef85fc3bf@v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447964', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115667', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '186246856501395945', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '510f62b494e7bb5d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114236026880', 'san:volume_id': '510f62b494e7bb5d9018ccde20679aed93ec05fd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89615', 'name': 'v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e of volume s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots/v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot v_1a30ee4d-a4d7-4184-86c8-f72bbae0d90e deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=77,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.quota [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['2a6789ab-90ef-417c-8ced-f1b0a0cd906b', '41bbf8fe-bbdf-42e9-ab97-1f5ee9f74be6', 'd13a0401-5f2a-4bcb-b3eb-5ecc7459c972', 'b3666ee9-b0d6-40ec-b319-64ac1a253bed'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-917d2987-f244-484b-89ea-ed0ef85fc3bf-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-917d2987-f244-484b-89ea-ed0ef85fc3bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_917d2987-f244-484b-89ea-ed0ef85fc3bf. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226245632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.manager [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:29:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Deleted volume successfully. Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e9d7dd86-32d5-48b1-9465-2716ed9bf0ed tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-1a30ee4d-a4d7-4184-86c8-f72bbae0d90e-delete_volume" released by "delete_volume" :: held 3.915s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_917d2987-f244-484b-89ea-ed0ef85fc3bf info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_887d7462-95a3-4b76-b25b-7d333e7704e8@s_917d2987-f244-484b-89ea-ed0ef85fc3bf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_917d2987-f244-484b-89ea-ed0ef85fc3bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447961', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115661', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '951342824423446973', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '53f1ce20f43efa31', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226245632', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88063', 'name': 's_917d2987-f244-484b-89ea-ed0ef85fc3bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_917d2987-f244-484b-89ea-ed0ef85fc3bf of volume v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:29:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots/s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots/s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots/s_917d2987-f244-484b-89ea-ed0ef85fc3bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_917d2987-f244-484b-89ea-ed0ef85fc3bf deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:29:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['769c81a9-26bf-4046-91c6-02b6e0e77a51', '1335d549-7fb5-4922-84c5-ebe4a00dfafa', 'fac4baf8-4328-4ba2-aece-abef6228ed27', 'f1376ed8-5ee0-42c3-941a-4cc4981d73b7'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:29:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:29:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9ab488b4-d60b-4a2f-8683-823cf48775ac tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-917d2987-f244-484b-89ea-ed0ef85fc3bf-delete_snapshot" released by "delete_snapshot" :: held 3.036s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-887d7462-95a3-4b76-b25b-7d333e7704e8-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-887d7462-95a3-4b76-b25b-7d333e7704e8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: 887d7462-95a3-4b76-b25b-7d333e7704e8. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1490175981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=887d7462-95a3-4b76-b25b-7d333e7704e8,launched_at=2023-04-14T04:29:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP kKrVQpaU py03LHPjkn8vTW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:08Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:29:24Z,updated_at=2023-04-14T04:29:24Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_887d7462-95a3-4b76-b25b-7d333e7704e8 from target iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8/luns/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8/luns/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8/luns/v_887d7462-95a3-4b76-b25b-7d333e7704e8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8/luns/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 because of JDSS resource v_887d7462-95a3-4b76-b25b-7d333e7704e8 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 because of JDSS resource iqn.2010-10.org.openstack:887d7462-95a3-4b76-b25b-7d333e7704e8 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating volume v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_887d7462-95a3-4b76-b25b-7d333e7704e8 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114226106368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:29:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:29:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_887d7462-95a3-4b76-b25b-7d333e7704e8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447957', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115651', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5953737900316305849', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e07a58943319402d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226106368', 'san:volume_id': 'e07a58943319402d1ae3035b602a12ac42e0e136', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88051', 'name': 'v_887d7462-95a3-4b76-b25b-7d333e7704e8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] delete volume:v_887d7462-95a3-4b76-b25b-7d333e7704e8 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:29:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_887d7462-95a3-4b76-b25b-7d333e7704e8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] volume v_887d7462-95a3-4b76-b25b-7d333e7704e8 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.quota [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['11b19296-a8dd-4b74-9ce8-1f1f390c5ceb', '982ea195-53a3-40b2-a52b-42ca8d29becb', '8e9e3fdf-c5e8-400e-84a7-eb591aeb2e26', '62903d51-bc55-4496-8bc8-50639dfbd3cd'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (51ab1fa0-78e4-4720-a338-f2f186ea6a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2244639-643f-416a-9a9d-564713f36c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2244639-643f-416a-9a9d-564713f36c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-949698240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e80e1c4c-5148-4a54-867b-e8380ae377bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:29:28Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf1cf6c-cf63-4a94-9119-638b356c2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf1cf6c-cf63-4a94-9119-638b356c2454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f5438-2556-45dd-8ff3-6391196d7860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f5438-2556-45dd-8ff3-6391196d7860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80e1c4c-5148-4a54-867b-e8380ae377bf', 'volume_name': 'volume-e80e1c4c-5148-4a54-867b-e8380ae377bf', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb5bb9e-9175-4ee7-a4da-9b9b34b3b0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb5bb9e-9175-4ee7-a4da-9b9b34b3b0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e471c3-0b06-479a-95f6-b9471c2c3cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume e80e1c4c-5148-4a54-867b-e8380ae377bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80e1c4c-5148-4a54-867b-e8380ae377bf', 'volume_size': 1} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] creating volume v_e80e1c4c-5148-4a54-867b-e8380ae377bf. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume {'name': 'v_e80e1c4c-5148-4a54-867b-e8380ae377bf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226180096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.manager [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:29:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Deleted volume successfully. Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5cb376e8-7f5f-4adf-b63e-e4a3514a8e33 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-887d7462-95a3-4b76-b25b-7d333e7704e8-delete_volume" released by "delete_volume" :: held 3.945s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e80e1c4c-5148-4a54-867b-e8380ae377bf', 'is_clone': False, 'name': 'v_e80e1c4c-5148-4a54-867b-e8380ae377bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e471c3-0b06-479a-95f6-b9471c2c3cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80e1c4c-5148-4a54-867b-e8380ae377bf', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5aba8d-7b7d-4b9a-a329-a5cc0d3c9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume volume-e80e1c4c-5148-4a54-867b-e8380ae377bf (e80e1c4c-5148-4a54-867b-e8380ae377bf): created successfully Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5aba8d-7b7d-4b9a-a329-a5cc0d3c9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (51ab1fa0-78e4-4720-a338-f2f186ea6a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2dc973ca-aead-4fcc-b2e8-e104d0753b10 tempest-VolumesSnapshotTestJSON-1226436274 None] Created volume successfully. Apr 14 04:29:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot 28574f84-fd6c-4020-8e28-d8d0bfbd1d5f for volume e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:29:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning v_e80e1c4c-5148-4a54-867b-e8380ae377bf to s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:29:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:29:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f from snapshot s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:29:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e80e1c4c-5148-4a54-867b-e8380ae377bf@s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f', 'is_clone': True, 'full_name': 'Pool-0/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f', 'name': 's_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] volume s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:29:32 user cinder-volume[73393]: INFO cinder.volume.manager [None req-35edbd6e-10b5-4702-b477-2143a23b7cd5 tempest-VolumesSnapshotTestJSON-1226436274 None] Create snapshot completed successfully Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (846af180-3034-4b5f-bcd1-ddadedc5c5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5155ef2-2499-4647-a60d-8e3c33b13130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5155ef2-2499-4647-a60d-8e3c33b13130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-657078275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f6f841a7-7dc9-4b5d-bf88-55e07bcaa395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=28574f84-fd6c-4020-8e28-d8d0bfbd1d5f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:29:34Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b65fdea-ee0e-4b81-b9bf-ed52e018cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b65fdea-ee0e-4b81-b9bf-ed52e018cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e980806f-81fd-4e4c-8a7e-6b9f2ca08387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e980806f-81fd-4e4c-8a7e-6b9f2ca08387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'volume_name': 'volume-f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'volume_size': 1, 'snapshot_id': '28574f84-fd6c-4020-8e28-d8d0bfbd1d5f'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6cf499-2339-4981-a497-487e3c48ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6cf499-2339-4981-a497-487e3c48ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be71df8c-9b70-478b-8d5d-0cda445c1df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:33 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume f6f841a7-7dc9-4b5d-bf88-55e07bcaa395: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'volume_size': 1, 'snapshot_id': '28574f84-fd6c-4020-8e28-d8d0bfbd1d5f'} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 from snapshot 28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] cloning s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f to v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] create snapshot v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] create volume v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 from snapshot v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f@v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'is_clone': True, 'full_name': 'Pool-0/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'name': 'v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f@v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447984', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115693', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12280761662861680418', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3664bdce1166795f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226085888', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89392', 'name': 'v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be71df8c-9b70-478b-8d5d-0cda445c1df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'volume_size': 1, 'snapshot_id': '28574f84-fd6c-4020-8e28-d8d0bfbd1d5f'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efbbfcd-07f1-4ecd-9b0b-07c8c5cbcbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:29:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Volume volume-f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 (f6f841a7-7dc9-4b5d-bf88-55e07bcaa395): created successfully Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efbbfcd-07f1-4ecd-9b0b-07c8c5cbcbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:29:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Flow 'volume_create_manager' (846af180-3034-4b5f-bcd1-ddadedc5c5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:29:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8e3c0a99-cc91-45d5-aacf-b241d1bdf749 tempest-VolumesSnapshotTestJSON-1226436274 None] Created volume successfully. Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-f6f841a7-7dc9-4b5d-bf88-55e07bcaa395-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-f6f841a7-7dc9-4b5d-bf88-55e07bcaa395-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: f6f841a7-7dc9-4b5d-bf88-55e07bcaa395. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-657078275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f6f841a7-7dc9-4b5d-bf88-55e07bcaa395,launched_at=2023-04-14T04:29:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP jvYlJRqN kIZ3aYVSfBuAUp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:34Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=28574f84-fd6c-4020-8e28-d8d0bfbd1d5f,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:29:37Z,updated_at=2023-04-14T04:29:37Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 from target iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395/luns/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395/luns/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395/luns/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395/luns/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 because of JDSS resource v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 because of JDSS resource iqn.2010-10.org.openstack:f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating volume v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f@v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447984', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115693', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12280761662861680418', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3664bdce1166795f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226061312', 'san:volume_id': '3664bdce1166795f018bac4806b1513ce52436a8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89392', 'name': 'v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 of volume s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots/v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot v_f6f841a7-7dc9-4b5d-bf88-55e07bcaa395 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG cinder.quota [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['2165e921-f7fa-4848-a66a-cfcff1da1d0b', '4fa98bd4-6e43-43aa-a2c4-89fa906a1a2e', '65c5f1f5-f3d8-45bd-81ec-ee7b1245cdff', 'e67f4ceb-8d92-4fd0-9518-4e9f4606e1e4'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=32,cinder:SELECT=59,cinder:DELETE=3,cinder:INSERT=6 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226085888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.manager [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:29:40 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Deleted volume successfully. Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-8389ab59-47cf-4bb4-8fd4-2daa21c55072 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-f6f841a7-7dc9-4b5d-bf88-55e07bcaa395-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-28574f84-fd6c-4020-8e28-d8d0bfbd1d5f-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-28574f84-fd6c-4020-8e28-d8d0bfbd1d5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] deleating snapshot s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] get volume s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e80e1c4c-5148-4a54-867b-e8380ae377bf@s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447980', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115687', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1772790718249122112', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3f243fece152223b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226085888', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89644', 'name': 's_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] delete snapshot s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f of volume v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots/s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] snapshot s_28574f84-fd6c-4020-8e28-d8d0bfbd1d5f deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:29:42 user cinder-volume[73393]: DEBUG cinder.quota [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['cdfe2f0b-698f-4a53-a833-35f37be00dce', 'f73422de-5bb4-4d2c-af71-49ad950a7cfe', '594910f8-8668-44dc-9698-492d07f179b3', '1acc3658-d209-4083-b476-27af8f49bb07'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:29:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Delete snapshot completed successfully. Apr 14 04:29:42 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5ed453ea-b657-48d3-a161-1ece049b1b8b tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-28574f84-fd6c-4020-8e28-d8d0bfbd1d5f-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-e80e1c4c-5148-4a54-867b-e8380ae377bf-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-e80e1c4c-5148-4a54-867b-e8380ae377bf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: e80e1c4c-5148-4a54-867b-e8380ae377bf. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-949698240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e80e1c4c-5148-4a54-867b-e8380ae377bf,launched_at=2023-04-14T04:29:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP MCroZdcu QNU6TO5reSC23D',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:29:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:29:44Z,updated_at=2023-04-14T04:29:44Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_e80e1c4c-5148-4a54-867b-e8380ae377bf from target iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf/luns/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf/luns/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf/luns/v_e80e1c4c-5148-4a54-867b-e8380ae377bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf/luns/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf because of JDSS resource v_e80e1c4c-5148-4a54-867b-e8380ae377bf DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf because of JDSS resource iqn.2010-10.org.openstack:e80e1c4c-5148-4a54-867b-e8380ae377bf DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating volume v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_e80e1c4c-5148-4a54-867b-e8380ae377bf info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e80e1c4c-5148-4a54-867b-e8380ae377bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447977', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115681', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3484280704101791786', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b3bf81167a866585', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226098176', 'san:volume_id': 'b3bf81167a8665853e6ed7b02020308b50811621', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89631', 'name': 'v_e80e1c4c-5148-4a54-867b-e8380ae377bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] delete volume:v_e80e1c4c-5148-4a54-867b-e8380ae377bf recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e80e1c4c-5148-4a54-867b-e8380ae377bf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] volume v_e80e1c4c-5148-4a54-867b-e8380ae377bf deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:29:46 user cinder-volume[73393]: DEBUG cinder.quota [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['9c6e00da-6be6-41ef-9d6f-d678942516ae', '80ba4388-8caa-4d10-b7f8-9c6bd90b835f', 'd3de3b40-bc0f-447d-958d-66dbdf3cffe6', '43f40974-b820-43bc-afbc-c85a80e97fcf'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:29:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:29:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:29:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Acquiring lock "cinder-b9113785-28aa-46da-ae7d-d2f2e9a011b2-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-b9113785-28aa-46da-ae7d-d2f2e9a011b2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] remove_export for volume: b9113785-28aa-46da-ae7d-d2f2e9a011b2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-813561633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9113785-28aa-46da-ae7d-d2f2e9a011b2,launched_at=2023-04-14T04:22:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848c9a67e2746e5b12b73920215b729',provider_auth='CHAP IWZgAHoj Oejg2LTE8iNlwR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:22:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:29:47Z,updated_at=2023-04-14T04:29:47Z,use_quota=True,user_id='e4a70281d6734c15b3c4b1b00e4b5d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] detach volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 from target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2/luns/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 because of JDSS resource v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target: iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] delete target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] failed to remove resource iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 because of JDSS resource iqn.2010-10.org.openstack:b9113785-28aa-46da-ae7d-d2f2e9a011b2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] deleating volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] get snapshots for volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226180096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.manager [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:29:47 user cinder-volume[73393]: INFO cinder.volume.manager [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Deleted volume successfully. Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-370b8187-4ac7-4021-9aaa-d1a675161aa3 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-e80e1c4c-5148-4a54-867b-e8380ae377bf-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] get volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447557', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115166', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13544098986248599454', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '66195a564a7e16f0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226180096', 'san:volume_id': '66195a564a7e16f048a340656e503c17dc30e5a5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88143', 'name': 'v_b9113785-28aa-46da-ae7d-d2f2e9a011b2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] delete volume:v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] volume v_b9113785-28aa-46da-ae7d-d2f2e9a011b2 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:29:49 user cinder-volume[73393]: DEBUG cinder.quota [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Created reservations ['e43ca78f-1250-4e29-b443-b54c5b3bffaf', '0653ded7-63ce-405d-8daa-c83eeda4b56a', 'c57c45bf-fa25-47ed-8026-3209428d2b5b', '4eb61b24-1ca4-4930-8507-65f10ee10d7b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:29:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:29:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:29:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226278400', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:29:50 user cinder-volume[73393]: DEBUG cinder.manager [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:29:50 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Deleted volume successfully. Apr 14 04:29:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d1561dec-d381-4d41-8910-de43260bc455 tempest-VolumesSnapshotTestJSON-1226436274 None] Lock "cinder-b9113785-28aa-46da-ae7d-d2f2e9a011b2-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.coordination [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Acquiring lock "cinder-90c1922d-91ec-49ff-8993-980caa04a670-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.coordination [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-90c1922d-91ec-49ff-8993-980caa04a670-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: 90c1922d-91ec-49ff-8993-980caa04a670. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1106199434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=90c1922d-91ec-49ff-8993-980caa04a670,launched_at=2023-04-14T04:28:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP wAqINGHP b7IdZeqw8JOa5B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:56Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=5dab436b-0543-4a34-92eb-ba093c0be7b0,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:29:59Z,updated_at=2023-04-14T04:29:59Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_90c1922d-91ec-49ff-8993-980caa04a670 from target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns/v_90c1922d-91ec-49ff-8993-980caa04a670'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670/luns/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 because of JDSS resource v_90c1922d-91ec-49ff-8993-980caa04a670 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 because of JDSS resource iqn.2010-10.org.openstack:90c1922d-91ec-49ff-8993-980caa04a670 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] deleating volume v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] get snapshots for volume v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] get volume v_90c1922d-91ec-49ff-8993-980caa04a670 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5dab436b-0543-4a34-92eb-ba093c0be7b0@v_90c1922d-91ec-49ff-8993-980caa04a670', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_90c1922d-91ec-49ff-8993-980caa04a670', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447946', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '115630', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17589410147304735183', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '8ecf64691c903ec1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226253824', 'san:volume_id': '8ecf64691c903ec13396630cc787926bc38a57c8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '88786', 'name': 'v_90c1922d-91ec-49ff-8993-980caa04a670', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] delete snapshot v_90c1922d-91ec-49ff-8993-980caa04a670 of volume s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:29:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots/v_90c1922d-91ec-49ff-8993-980caa04a670 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] snapshot v_90c1922d-91ec-49ff-8993-980caa04a670 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG cinder.quota [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Created reservations ['85d59d4d-4b66-45e2-a87a-52f4e0132c6d', '5ac0ba6c-0f88-41c8-bb5c-8a18a7a97a68', '27e4aa5e-e125-4f29-9696-eb05eea7fd97', 'a0ab980e-ba15-4ce0-b66c-d77f16feb2c8'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=52,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=11 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Acquiring lock "cinder-babb4943-f427-4d60-8c85-091fdae699ee-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-babb4943-f427-4d60-8c85-091fdae699ee-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: babb4943-f427-4d60-8c85-091fdae699ee. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-850938353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=babb4943-f427-4d60-8c85-091fdae699ee,launched_at=2023-04-14T04:27:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP wXCvrjzG uq98UWFmvQz1Kf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:27:53Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=ebfb94ca-56aa-463a-aa4c-b5ad41138884,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:30:02Z,updated_at=2023-04-14T04:30:02Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_babb4943-f427-4d60-8c85-091fdae699ee from target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226421760', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.manager [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Deleted volume successfully. Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-68084b1f-b6a6-456b-9652-13392c6150bc tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-90c1922d-91ec-49ff-8993-980caa04a670-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns/v_babb4943-f427-4d60-8c85-091fdae699ee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee/luns/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee because of JDSS resource v_babb4943-f427-4d60-8c85-091fdae699ee DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee because of JDSS resource iqn.2010-10.org.openstack:babb4943-f427-4d60-8c85-091fdae699ee DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] deleating volume v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] get snapshots for volume v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] get volume v_babb4943-f427-4d60-8c85-091fdae699ee info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884@v_babb4943-f427-4d60-8c85-091fdae699ee', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_babb4943-f427-4d60-8c85-091fdae699ee', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447883', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '115551', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6379639068045532125', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '953582ffe51d589d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226421760', 'san:volume_id': '953582ffe51d589dfa1815037481b00e27490f47', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '89262', 'name': 'v_babb4943-f427-4d60-8c85-091fdae699ee', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] delete snapshot v_babb4943-f427-4d60-8c85-091fdae699ee of volume s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] create export for volume: bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] ensure volume bcb3b184-a10d-482d-8c49-1bee42873be4 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] check if targe iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots/v_babb4943-f427-4d60-8c85-091fdae699ee {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] snapshot v_babb4943-f427-4d60-8c85-091fdae699ee deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] create target and attach volume bcb3b184-a10d-482d-8c49-1bee42873be4 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] create target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.quota [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Created reservations ['57b71688-9c95-4aaa-8495-4c7b02b67662', '524ad630-33f6-492a-8f93-7bfdd77fe1d9', '8c1f4c70-4022-4c81-a248-30695f4a63b7', '2d09a597-c9fc-4512-b860-2217ea2a3cc3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:INSERT=8,cinder:UPDATE=35 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Acquiring lock "cinder-430bf7a7-6067-4516-9a60-f895bded451d-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-430bf7a7-6067-4516-9a60-f895bded451d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: 430bf7a7-6067-4516-9a60-f895bded451d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2146923826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=430bf7a7-6067-4516-9a60-f895bded451d,launched_at=2023-04-14T04:26:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP xaQKgXWG EYkBfaNPstelFn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:51Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=920e0be0-a7a6-4a21-a78a-451b09f475ff,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:30:06Z,updated_at=2023-04-14T04:30:06Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_430bf7a7-6067-4516-9a60-f895bded451d from target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns/v_430bf7a7-6067-4516-9a60-f895bded451d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d/luns/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d because of JDSS resource v_430bf7a7-6067-4516-9a60-f895bded451d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d because of JDSS resource iqn.2010-10.org.openstack:430bf7a7-6067-4516-9a60-f895bded451d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] deleating volume v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] get snapshots for volume v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] get volume v_430bf7a7-6067-4516-9a60-f895bded451d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_920e0be0-a7a6-4a21-a78a-451b09f475ff@v_430bf7a7-6067-4516-9a60-f895bded451d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_430bf7a7-6067-4516-9a60-f895bded451d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447820', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '115503', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '827336783053025989', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '19f01b2857c038c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226552832', 'san:volume_id': '19f01b2857c038c868aca507eee51f05026fd9ff', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '89507', 'name': 'v_430bf7a7-6067-4516-9a60-f895bded451d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] delete snapshot v_430bf7a7-6067-4516-9a60-f895bded451d of volume s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Acquiring lock "cinder-43b7dada-23d8-4db0-9be7-b0fff3287b15-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Lock "cinder-43b7dada-23d8-4db0-9be7-b0fff3287b15-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] remove_export for volume: 43b7dada-23d8-4db0-9be7-b0fff3287b15. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569246463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=43b7dada-23d8-4db0-9be7-b0fff3287b15,launched_at=2023-04-14T04:29:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth='CHAP BPQNykGu kDBASTO9xYPV1F',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:59Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:30:07Z,updated_at=2023-04-14T04:30:07Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] detach volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15 from target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns/v_43b7dada-23d8-4db0-9be7-b0fff3287b15'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15/luns/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] failed to remove resource iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 because of JDSS resource v_43b7dada-23d8-4db0-9be7-b0fff3287b15 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] delete target: iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] delete target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] failed to remove resource iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 because of JDSS resource iqn.2010-10.org.openstack:43b7dada-23d8-4db0-9be7-b0fff3287b15 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] deleating volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] get snapshots for volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] get volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_43b7dada-23d8-4db0-9be7-b0fff3287b15', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447948', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115634', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11472275879688145815', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e1345fd8708a25e9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226552832', 'san:volume_id': 'e1345fd8708a25e90f4f862965f2cc579c5ac0c9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88039', 'name': 'v_43b7dada-23d8-4db0-9be7-b0fff3287b15', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] delete volume:v_43b7dada-23d8-4db0-9be7-b0fff3287b15 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] atach volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 to target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots/v_430bf7a7-6067-4516-9a60-f895bded451d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] snapshot v_430bf7a7-6067-4516-9a60-f895bded451d deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.quota [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Created reservations ['7c0f8d0f-a90b-405c-bb88-45e9f1e8b01e', 'cc367a6d-b5ad-4228-bba4-8ce4810b101b', 'cd1e6dc5-2c47-4276-8742-91e9e50a3806', 'b7632b60-bb7d-4920-8085-3a6abc23168c'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226696192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.manager [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Deleted volume successfully. Apr 14 04:30:08 user cinder-volume[73393]: DEBUG cinder.coordination [None req-52d4145e-7848-4fab-878f-d8657b6582df tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-babb4943-f427-4d60-8c85-091fdae699ee-delete_volume" released by "delete_volume" :: held 6.193s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Acquiring lock "cinder-5dab436b-0543-4a34-92eb-ba093c0be7b0-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-5dab436b-0543-4a34-92eb-ba093c0be7b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] deleating snapshot s_5dab436b-0543-4a34-92eb-ba093c0be7b0. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] get snapshots for volume s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226753536', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.manager [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:09 user cinder-volume[73393]: INFO cinder.volume.manager [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Deleted volume successfully. Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-69c6c904-3379-42e5-a98b-aa4af4b1ff1a tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-430bf7a7-6067-4516-9a60-f895bded451d-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43b7dada-23d8-4db0-9be7-b0fff3287b15 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] volume v_43b7dada-23d8-4db0-9be7-b0fff3287b15 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.quota [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Created reservations ['df1bfd00-f60a-47d9-a21b-f38b1412dccb', 'b019c257-a61a-41cd-9ddd-57004e0fabf8', '52723f91-a653-459a-93ea-c3f65d2e62a7', 'b86a4eca-58ac-4db2-85db-22b2cb636607'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Acquiring lock "cinder-e11df2cb-b474-4faf-afdf-a1c4e7d905ad-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Lock "cinder-e11df2cb-b474-4faf-afdf-a1c4e7d905ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3164336261353930', 'lun': 0, 'mode': 'wt', 'name': 'v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'prod_id': 'Storage', 'scsi_id': '1d3ba59022c2b5d2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] add credentails to target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] remove_export for volume: e11df2cb-b474-4faf-afdf-a1c4e7d905ad. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221184690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e11df2cb-b474-4faf-afdf-a1c4e7d905ad,launched_at=2023-04-14T04:28:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth='CHAP rETDPxvm DS2m0LgdV6P7tX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:48Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:30:10Z,updated_at=2023-04-14T04:30:10Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] detach volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad from target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad/luns/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] failed to remove resource iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad because of JDSS resource v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] delete target: iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] delete target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] failed to remove resource iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad because of JDSS resource iqn.2010-10.org.openstack:e11df2cb-b474-4faf-afdf-a1c4e7d905ad DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] deleating volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] get snapshots for volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226778112', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.manager [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Deleted volume successfully. Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-fb3753bf-5abf-4100-94fd-0b26750bd044 tempest-AttachVolumeTestJSON-991906288 None] Lock "cinder-43b7dada-23d8-4db0-9be7-b0fff3287b15-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Flow 'volume_create_manager' (2dcd8e05-8c7c-48ad-8d8e-3f76b9558d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d1ef37-06a3-4565-a564-e1fb55c5663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d1ef37-06a3-4565-a564-e1fb55c5663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-292530258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cd931337-f058-4d2e-bb9b-21d50e96a28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6175a4372245a4a57dca1f12f7f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:30:10Z,use_quota=True,user_id='ebe3f41b95824cd78193d0bbe206a66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad641921-744e-48bb-b309-29bba661885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad641921-744e-48bb-b309-29bba661885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463f43f1-a7bf-40b1-ad91-9d16d88131a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463f43f1-a7bf-40b1-ad91-9d16d88131a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd931337-f058-4d2e-bb9b-21d50e96a28b', 'volume_name': 'volume-cd931337-f058-4d2e-bb9b-21d50e96a28b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303a8122-f485-42fd-85f0-203d91347667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303a8122-f485-42fd-85f0-203d91347667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce86a99a-c397-4763-bf3e-e2566a8d4283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:10 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Volume cd931337-f058-4d2e-bb9b-21d50e96a28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd931337-f058-4d2e-bb9b-21d50e96a28b', 'volume_size': 1} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] creating volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] create volume {'name': 'v_cd931337-f058-4d2e-bb9b-21d50e96a28b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] get volume s_5dab436b-0543-4a34-92eb-ba093c0be7b0 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] get volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447937', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115614', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17027912811460016807', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '499317af467792d3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226778112', 'san:volume_id': '499317af467792d397a6a45455b4a7d020185502', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88397', 'name': 'v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] delete volume:v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Geting {'code': 201, 'error': None, 'data': {'name': 'pRhHtNJB'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] initialize_connection for bcb3b184-a10d-482d-8c49-1bee42873be4 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRhHtNJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '481ca92d-3524-46cf-9ee5-774a508c88e2'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:UPDATE=35,cinder:DELETE=2,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:10 user cinder-volume[73393]: INFO cinder.volume.manager [req-d7bc4828-10f8-429f-a487-6a5151cf59c1 req-1f681b55-6331-4ab9-83fc-f1c9f35d5843 tempest-TestShelveInstance-1458140851 None] attachment_update completed successfully. Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913@s_5dab436b-0543-4a34-92eb-ba093c0be7b0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_5dab436b-0543-4a34-92eb-ba093c0be7b0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447767', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '115438', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17001878876398859137', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '36460f0cd3b420a6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226778112', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '88183', 'name': 's_5dab436b-0543-4a34-92eb-ba093c0be7b0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] delete snapshot s_5dab436b-0543-4a34-92eb-ba093c0be7b0 of volume v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_cd931337-f058-4d2e-bb9b-21d50e96a28b', 'is_clone': False, 'name': 'v_cd931337-f058-4d2e-bb9b-21d50e96a28b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce86a99a-c397-4763-bf3e-e2566a8d4283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd931337-f058-4d2e-bb9b-21d50e96a28b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04357d4d-e3df-43b3-857e-0e5145397f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:11 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Volume volume-cd931337-f058-4d2e-bb9b-21d50e96a28b (cd931337-f058-4d2e-bb9b-21d50e96a28b): created successfully Apr 14 04:30:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04357d4d-e3df-43b3-857e-0e5145397f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Flow 'volume_create_manager' (2dcd8e05-8c7c-48ad-8d8e-3f76b9558d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:11 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fb623743-4a9a-44c4-b0ed-95d27eef28cb tempest-TestStampPattern-267011728 None] Created volume successfully. Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] volume v_e11df2cb-b474-4faf-afdf-a1c4e7d905ad deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.quota [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Created reservations ['6502c56e-637a-4912-92a2-976fae96610a', 'cb129024-3fc0-4bb7-b58d-1d2117a1cbf3', '4877f8f7-fd49-4c9f-a52a-0c1b2de3a2d0', '25054e10-6323-4706-97de-ac7e7d46568c'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_5dab436b-0543-4a34-92eb-ba093c0be7b0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] snapshot s_5dab436b-0543-4a34-92eb-ba093c0be7b0 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.quota [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Created reservations ['1a89246a-7888-4223-b400-257625f2d071', '5c1f21ee-812d-4d9f-a656-4598935302bd', '79e26e89-24ef-433a-aa39-13ab0c85de26', 'c9fdc705-effb-4100-8828-ecc09e5f6173'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:12 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=35,cinder:SELECT=52,cinder:INSERT=10,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Delete snapshot completed successfully. Apr 14 04:30:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-10b5cbef-79c2-4cfa-ac65-c6da7cee81e9 tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-5dab436b-0543-4a34-92eb-ba093c0be7b0-delete_snapshot" released by "delete_snapshot" :: held 3.684s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'available': '114226823168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.manager [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Acquiring lock "cinder-b7e94002-3eeb-442d-b224-ef83dacfa5a4-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Deleted volume successfully. Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Lock "cinder-b7e94002-3eeb-442d-b224-ef83dacfa5a4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a6a44b27-5d31-4e11-afb8-393262fca76e tempest-AttachVolumeTestJSON-991906288 None] Lock "cinder-e11df2cb-b474-4faf-afdf-a1c4e7d905ad-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] remove_export for volume: b7e94002-3eeb-442d-b224-ef83dacfa5a4. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2034099743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b7e94002-3eeb-442d-b224-ef83dacfa5a4,launched_at=2023-04-14T04:18:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a89255339f74e55ad7c92967558bb81',provider_auth='CHAP mfOroQgL sDeC2NEGSfc6Ai',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:18:26Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:30:13Z,updated_at=2023-04-14T04:30:13Z,use_quota=True,user_id='7610b45003e34f3395268977612f6c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] detach volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 from target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4/luns/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] failed to remove resource iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 because of JDSS resource v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] delete target: iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] delete target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Acquiring lock "cinder-ebfb94ca-56aa-463a-aa4c-b5ad41138884-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-ebfb94ca-56aa-463a-aa4c-b5ad41138884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] deleating snapshot s_ebfb94ca-56aa-463a-aa4c-b5ad41138884. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] get snapshots for volume s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] failed to remove resource iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 because of JDSS resource iqn.2010-10.org.openstack:b7e94002-3eeb-442d-b224-ef83dacfa5a4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] deleating volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] get snapshots for volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] get volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] get volume s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447315', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114863', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6949420804040450049', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4c6cddb1461e2abb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226823168', 'san:volume_id': '4c6cddb1461e2abb967343fca5a22aa18e4a8b96', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87747', 'name': 'v_b7e94002-3eeb-442d-b224-ef83dacfa5a4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] delete volume:v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913@s_ebfb94ca-56aa-463a-aa4c-b5ad41138884', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447763', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '115420', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '640196360981614014', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dc13f2080f11ff57', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114226823168', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '88843', 'name': 's_ebfb94ca-56aa-463a-aa4c-b5ad41138884', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] delete snapshot s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 of volume v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] snapshot s_ebfb94ca-56aa-463a-aa4c-b5ad41138884 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] volume v_b7e94002-3eeb-442d-b224-ef83dacfa5a4 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.quota [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Created reservations ['a9499412-47c6-47a5-aad6-2df8b0381556', '63d1627d-1b0b-40e3-a05f-05cb7b3ce778', 'b1c6625b-5988-4bdc-9ab5-69f9da669e59', '1d71627c-de06-4102-81a4-7981c1a7da9e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.quota [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Created reservations ['19a1f4ed-2b71-4e3f-aa5c-4f2b67ae7de6', '1395ffcd-e07a-4d9f-b313-c274bd431e36', '0bb22eba-6fb8-482a-b236-6d51c6eeae1e', '1ec3de4d-e507-452b-81f1-17c3cd1da1f3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Delete snapshot completed successfully. Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d08898dd-699e-45ab-99d2-3568b60e260c tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-ebfb94ca-56aa-463a-aa4c-b5ad41138884-delete_snapshot" released by "delete_snapshot" :: held 2.695s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Acquiring lock "cinder-920e0be0-a7a6-4a21-a78a-451b09f475ff-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-920e0be0-a7a6-4a21-a78a-451b09f475ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] deleating snapshot s_920e0be0-a7a6-4a21-a78a-451b09f475ff. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] get snapshots for volume s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227175424', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.manager [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Deleted volume successfully. Apr 14 04:30:16 user cinder-volume[73393]: DEBUG cinder.coordination [None req-76da6f3d-ab2b-4955-b274-7eeee2a1b7a4 tempest-AttachVolumeTestJSON-991906288 None] Lock "cinder-b7e94002-3eeb-442d-b224-ef83dacfa5a4-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] get volume s_920e0be0-a7a6-4a21-a78a-451b09f475ff info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913@s_920e0be0-a7a6-4a21-a78a-451b09f475ff', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_920e0be0-a7a6-4a21-a78a-451b09f475ff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447759', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '115408', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3219478306782411141', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '33323aae3ce29bad', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227175424', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '88974', 'name': 's_920e0be0-a7a6-4a21-a78a-451b09f475ff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] delete snapshot s_920e0be0-a7a6-4a21-a78a-451b09f475ff of volume v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots/s_920e0be0-a7a6-4a21-a78a-451b09f475ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] snapshot s_920e0be0-a7a6-4a21-a78a-451b09f475ff deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:30:19 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:UPDATE=29,cinder:INSERT=12,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:19 user cinder-volume[73393]: DEBUG cinder.quota [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Created reservations ['48c40244-155f-4a4d-8366-944e49947356', '001614f4-b823-46e5-9dc5-dcb7ec90c0fc', '069dd043-667c-4749-844a-ae890b15e4ef', '2a4cff6e-e383-4118-b3ae-ab2bdd96e25e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:19 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Delete snapshot completed successfully. Apr 14 04:30:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-c90627b1-9737-4b0a-9ba7-e02f02d0a874 tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-920e0be0-a7a6-4a21-a78a-451b09f475ff-delete_snapshot" released by "delete_snapshot" :: held 2.906s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Acquiring lock "cinder-8ee7c552-e40e-4341-992f-722c82128913-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-8ee7c552-e40e-4341-992f-722c82128913-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] remove_export for volume: 8ee7c552-e40e-4341-992f-722c82128913. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2031203237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8ee7c552-e40e-4341-992f-722c82128913,launched_at=2023-04-14T04:25:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39731dbb51484eff890a74b07241ba75',provider_auth='CHAP lSBjntEJ YE5qVP3ntzMbhu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:35Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:30:21Z,updated_at=2023-04-14T04:30:21Z,use_quota=True,user_id='0d3c1b814ec240279646878fd090f5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] detach volume v_8ee7c552-e40e-4341-992f-722c82128913 from target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns/v_8ee7c552-e40e-4341-992f-722c82128913'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913/luns/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 because of JDSS resource v_8ee7c552-e40e-4341-992f-722c82128913 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] delete target: iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] delete target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] failed to remove resource iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 because of JDSS resource iqn.2010-10.org.openstack:8ee7c552-e40e-4341-992f-722c82128913 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] deleating volume v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] get snapshots for volume v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] terminate connection for 9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:30:21 user cinder-volume[73393]: INFO cinder.volume.manager [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Terminate volume connection completed successfully. Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Deleting attachment 62991587-6529-4cf6-9702-0ab7621d58ca. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1226443700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9cdf2c58-c295-483e-b766-13e01129ede2,launched_at=2023-04-14T04:25:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP MjAZDWGc KyeNwxZHQq4i1a',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:24Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:27:42Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] detach volume v_9cdf2c58-c295-483e-b766-13e01129ede2 from target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] get volume v_8ee7c552-e40e-4341-992f-722c82128913 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8ee7c552-e40e-4341-992f-722c82128913', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447744', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '115379', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16487352435966619958', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '475136', 'logicalused': '1892352', 'compressratio': '4.52', 'rootcontext': 'none', 'default_scsi_id': '59b1f086db0630e7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227507200', 'san:volume_id': '59b1f086db0630e731ca537d8ec28019d82cba20', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '475136', 'objsetid': '88240', 'name': 'v_8ee7c552-e40e-4341-992f-722c82128913', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '475136', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] delete volume:v_8ee7c552-e40e-4341-992f-722c82128913 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 req-10d4adf5-901f-4364-a83a-7b3fa3b38ba9 tempest-ServerActionsTestJSON-1048786641 None] target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:30:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ee7c552-e40e-4341-992f-722c82128913 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] volume v_8ee7c552-e40e-4341-992f-722c82128913 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:30:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Created reservations ['10a8a75d-8faa-47b3-9ef1-80cca4215a1b', '78c39997-a681-42d1-8f85-968b6adb3af7', '4d25a3a3-5cf9-432a-8ff6-0da5800431d1', '0bb7a11c-ac3a-4c20-a298-a6b7ab42e20c'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114227175424', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Geting {'code': 200, 'error': None, 'data': {'available': '114228043776', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Deleted volume successfully. Apr 14 04:30:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2f866a5d-f537-4715-aa70-e20908ebc4c3 tempest-SnapshotDataIntegrityTests-502963555 None] Lock "cinder-8ee7c552-e40e-4341-992f-722c82128913-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:30:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ff1b343c-512f-4789-9346-9cac3b732728 tempest-GroupsTest-681347672 None] Group tempest-Group1-1599642293: creating Apr 14 04:30:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ff1b343c-512f-4789-9346-9cac3b732728 tempest-GroupsTest-681347672 None] Group tempest-Group1-1599642293: created successfully Apr 14 04:30:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ff1b343c-512f-4789-9346-9cac3b732728 tempest-GroupsTest-681347672 None] Create group completed successfully. Apr 14 04:30:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-030fe81c-a136-4b3d-b5cb-b83cebb546a4 tempest-GroupsTest-681347672 None] Group tempest-Group2-688521585: creating Apr 14 04:30:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-030fe81c-a136-4b3d-b5cb-b83cebb546a4 tempest-GroupsTest-681347672 None] Group tempest-Group2-688521585: created successfully Apr 14 04:30:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-030fe81c-a136-4b3d-b5cb-b83cebb546a4 tempest-GroupsTest-681347672 None] Create group completed successfully. Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Flow 'volume_create_manager' (7fc61535-0f65-41a1-92c1-f5a010cb5854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e78d80-ac53-44fb-a09d-69c56d016f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e78d80-ac53-44fb-a09d-69c56d016f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379003451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f2b8eb1-7098-43aa-a0ad-b663c0b5dd33,host='user@joviandss-2#joviandss-2',id=0964b026-147c-4ad2-9ba3-385ba73bcaf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6979d1df354918895f426dc68ef514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:30:32Z,use_quota=True,user_id='58bcced0f2194b38b14eabf952c49471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c1a795-3128-4ef0-9eb4-8316a2b8fc7f),volume_type_id=75c1a795-3128-4ef0-9eb4-8316a2b8fc7f)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bfe250-043a-45f3-9f07-f07202fce3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bfe250-043a-45f3-9f07-f07202fce3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697943c3-c99f-4038-a648-1e84a1c0453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697943c3-c99f-4038-a648-1e84a1c0453d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'volume_name': 'volume-0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1356f328-43ae-4b3d-a69c-4fe87e0dfb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1356f328-43ae-4b3d-a69c-4fe87e0dfb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09f6e67-4828-4bf1-97b2-988a234c47b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:31 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Volume 0964b026-147c-4ad2-9ba3-385ba73bcaf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'volume_size': 1} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] creating volume v_0964b026-147c-4ad2-9ba3-385ba73bcaf9. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] create volume {'name': 'v_0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'is_clone': False, 'name': 'v_0964b026-147c-4ad2-9ba3-385ba73bcaf9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09f6e67-4828-4bf1-97b2-988a234c47b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:32 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616af930-2450-46af-b9ed-3e4176a48afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:33 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Volume volume-0964b026-147c-4ad2-9ba3-385ba73bcaf9 (0964b026-147c-4ad2-9ba3-385ba73bcaf9): created successfully Apr 14 04:30:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616af930-2450-46af-b9ed-3e4176a48afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Flow 'volume_create_manager' (7fc61535-0f65-41a1-92c1-f5a010cb5854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:33 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6f0944ec-f504-4e8c-b3d5-312dc8bd8968 tempest-GroupsTest-681347672 None] Created volume successfully. Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] remove_export for volume: 0964b026-147c-4ad2-9ba3-385ba73bcaf9. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379003451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f2b8eb1-7098-43aa-a0ad-b663c0b5dd33,host='user@joviandss-2#joviandss-2',id=0964b026-147c-4ad2-9ba3-385ba73bcaf9,launched_at=2023-04-14T04:30:33Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6979d1df354918895f426dc68ef514',provider_auth='CHAP pCzAylGS rGq6Uj4ybxHw12',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:32Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:30:35Z,use_quota=True,user_id='58bcced0f2194b38b14eabf952c49471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c1a795-3128-4ef0-9eb4-8316a2b8fc7f),volume_type_id=75c1a795-3128-4ef0-9eb4-8316a2b8fc7f) from target:iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] detach volume v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 from target iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9/luns/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9/luns/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9/luns/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9/luns/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] failed to remove resource iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 because of JDSS resource v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] delete target: iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] delete target iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] failed to remove resource iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 because of JDSS resource iqn.2010-10.org.openstack:0964b026-147c-4ad2-9ba3-385ba73bcaf9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] deleating volume v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] get snapshots for volume v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] get volume v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448041', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115739', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7917421603678462930', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'acd72af028a18fb4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227961856', 'san:volume_id': 'acd72af028a18fb463ce6230405cd68f677d4336', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89142', 'name': 'v_0964b026-147c-4ad2-9ba3-385ba73bcaf9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] delete volume:v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] volume v_0964b026-147c-4ad2-9ba3-385ba73bcaf9 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.quota [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Created reservations ['335b224b-eac1-4e5d-953a-043d23818e17'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:DELETE=2,cinder:SELECT=62,cinder:INSERT=7,cinder:UPDATE=29 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:37 user cinder-volume[73393]: WARNING cinder.quota [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2091553163 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2091553163, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:30:37 user cinder-volume[73393]: WARNING cinder.quota [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2091553163 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2091553163, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.quota [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Created reservations ['66e073f0-80ed-4da2-8fb5-30c84204e644', '4c39ba2f-2ef6-4ff8-b6c6-b2a8f67c5cd9', '5ae8e9d5-f318-4b21-8055-dc581f575893', 'c97065a2-8131-4951-81cc-3a27ff525b9a'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'available': '114228031488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:37 user cinder-volume[73393]: DEBUG cinder.manager [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-73780f0c-5fff-4535-9af3-500f4266e559 tempest-GroupsTest-681347672 None] Delete group completed successfully. Apr 14 04:30:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=35,cinder:SELECT=59,cinder:INSERT=5,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.quota [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Created reservations ['84690043-8c7b-4a83-a6fb-77e051fc6c49'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'available': '114228031488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:38 user cinder-volume[73393]: DEBUG cinder.manager [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:38 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b9670e33-cfe0-4ae7-a857-c9849cfe80a7 tempest-GroupsTest-681347672 None] Delete group completed successfully. Apr 14 04:30:39 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ce4eacff-2a86-4dc7-a6ae-d886446539f9 tempest-GroupsTest-681347672 None] Group tempest-GroupsTest-Group-1644690253: creating Apr 14 04:30:39 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ce4eacff-2a86-4dc7-a6ae-d886446539f9 tempest-GroupsTest-681347672 None] Group tempest-GroupsTest-Group-1644690253: created successfully Apr 14 04:30:39 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ce4eacff-2a86-4dc7-a6ae-d886446539f9 tempest-GroupsTest-681347672 None] Create group completed successfully. Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Flow 'volume_create_manager' (0a04d253-b7e1-43bc-8943-e3908b80466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43315f5f-fb95-4e22-8cb8-c417bb94f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43315f5f-fb95-4e22-8cb8-c417bb94f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1633777313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=144c2429-5dcf-42e2-bd55-730bdb60bfcb,host='user@joviandss-2#joviandss-2',id=eabdf280-b286-457b-8592-f056805c5a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6979d1df354918895f426dc68ef514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:30:41Z,use_quota=True,user_id='58bcced0f2194b38b14eabf952c49471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d45e47b-6ca6-4b65-912e-cdc23e33fd05),volume_type_id=7d45e47b-6ca6-4b65-912e-cdc23e33fd05)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb980d-44c7-4665-a4f8-f47fe41d9e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb980d-44c7-4665-a4f8-f47fe41d9e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd38a63-7999-49f7-ae4f-0f0d2d379a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd38a63-7999-49f7-ae4f-0f0d2d379a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eabdf280-b286-457b-8592-f056805c5a3b', 'volume_name': 'volume-eabdf280-b286-457b-8592-f056805c5a3b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86822f9c-424d-4e64-8ff4-fefd4b2bcbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86822f9c-424d-4e64-8ff4-fefd4b2bcbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07311dce-1d56-426a-ac08-2c7db0227f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Volume eabdf280-b286-457b-8592-f056805c5a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eabdf280-b286-457b-8592-f056805c5a3b', 'volume_size': 1} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] creating volume v_eabdf280-b286-457b-8592-f056805c5a3b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] create volume {'name': 'v_eabdf280-b286-457b-8592-f056805c5a3b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_eabdf280-b286-457b-8592-f056805c5a3b', 'is_clone': False, 'name': 'v_eabdf280-b286-457b-8592-f056805c5a3b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07311dce-1d56-426a-ac08-2c7db0227f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eabdf280-b286-457b-8592-f056805c5a3b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fe0f41-67f4-464f-9b8f-15ce4fc6c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Volume volume-eabdf280-b286-457b-8592-f056805c5a3b (eabdf280-b286-457b-8592-f056805c5a3b): created successfully Apr 14 04:30:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fe0f41-67f4-464f-9b8f-15ce4fc6c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Flow 'volume_create_manager' (0a04d253-b7e1-43bc-8943-e3908b80466a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f8b0c9ea-bfc5-458a-b382-6a7a03ad52b1 tempest-GroupsTest-681347672 None] Created volume successfully. Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Flow 'volume_create_manager' (56dfb358-f6bd-418f-b6a1-72a5e85d24c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f6d701-1f4e-429f-a2c5-9ec9018fd27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f6d701-1f4e-429f-a2c5-9ec9018fd27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037143099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=144c2429-5dcf-42e2-bd55-730bdb60bfcb,host='user@joviandss-2#joviandss-2',id=216125a5-7d33-4a95-b4a2-fe2f6f4a889c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6979d1df354918895f426dc68ef514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:30:43Z,use_quota=True,user_id='58bcced0f2194b38b14eabf952c49471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d45e47b-6ca6-4b65-912e-cdc23e33fd05),volume_type_id=7d45e47b-6ca6-4b65-912e-cdc23e33fd05)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68628d42-cd9f-44cb-9d4d-9d259b81655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68628d42-cd9f-44cb-9d4d-9d259b81655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c75aa5-6342-49fa-887a-8e5ee816498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c75aa5-6342-49fa-887a-8e5ee816498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'volume_name': 'volume-216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a256f1-89ec-4e4a-8020-20d4b9e74893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a256f1-89ec-4e4a-8020-20d4b9e74893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2046c1a4-0a6a-45ec-88da-720ea5285ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:43 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Volume 216125a5-7d33-4a95-b4a2-fe2f6f4a889c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'volume_size': 1} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] creating volume v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] create volume {'name': 'v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'is_clone': False, 'name': 'v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2046c1a4-0a6a-45ec-88da-720ea5285ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba73554-58cf-46ed-9234-e35fc96dd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:44 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Volume volume-216125a5-7d33-4a95-b4a2-fe2f6f4a889c (216125a5-7d33-4a95-b4a2-fe2f6f4a889c): created successfully Apr 14 04:30:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba73554-58cf-46ed-9234-e35fc96dd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:44 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Flow 'volume_create_manager' (56dfb358-f6bd-418f-b6a1-72a5e85d24c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:44 user cinder-volume[73393]: INFO cinder.volume.manager [None req-830b89cf-b5f8-46f2-8c12-edb8a89a90db tempest-GroupsTest-681347672 None] Created volume successfully. Apr 14 04:30:45 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0450bbcd-4e80-4192-9c49-1ee25605389d tempest-GroupsTest-681347672 None] Update group completed successfully. Apr 14 04:30:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] create snapshot f5cc0b68-6502-4a55-96a0-69a8f27c433c for volume 300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:30:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] cloning v_300999d2-cadf-4299-8a05-85dec6b7d895 to s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:30:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] create snapshot s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:30:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:47 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4e0eb1dc-f5be-4f9a-a4d7-f529487c74c9 tempest-GroupsTest-681347672 None] Update group completed successfully. Apr 14 04:30:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f5cc0b68-6502-4a55-96a0-69a8f27c433c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] create volume s_f5cc0b68-6502-4a55-96a0-69a8f27c433c from snapshot s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:30:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_300999d2-cadf-4299-8a05-85dec6b7d895@s_f5cc0b68-6502-4a55-96a0-69a8f27c433c', 'is_clone': True, 'full_name': 'Pool-0/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c', 'name': 's_f5cc0b68-6502-4a55-96a0-69a8f27c433c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] volume s_f5cc0b68-6502-4a55-96a0-69a8f27c433c properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:30:48 user cinder-volume[73393]: INFO cinder.volume.manager [req-556dc318-d161-4e2c-adad-05ad970cbcf7 req-94083164-bf69-44d0-9a61-5cbbf0a0b597 tempest-TestVolumeBootPattern-1780160917 None] Create snapshot completed successfully Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] remove_export for volume: 216125a5-7d33-4a95-b4a2-fe2f6f4a889c. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037143099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=144c2429-5dcf-42e2-bd55-730bdb60bfcb,host='user@joviandss-2#joviandss-2',id=216125a5-7d33-4a95-b4a2-fe2f6f4a889c,launched_at=2023-04-14T04:30:45Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6979d1df354918895f426dc68ef514',provider_auth='CHAP AQBoMYec uHt9XEVWGmhPCw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:43Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:30:49Z,use_quota=True,user_id='58bcced0f2194b38b14eabf952c49471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d45e47b-6ca6-4b65-912e-cdc23e33fd05),volume_type_id=7d45e47b-6ca6-4b65-912e-cdc23e33fd05) from target:iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] detach volume v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c from target iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c/luns/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c/luns/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c/luns/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c/luns/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] failed to remove resource iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c because of JDSS resource v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] delete target: iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] delete target iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] failed to remove resource iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c because of JDSS resource iqn.2010-10.org.openstack:216125a5-7d33-4a95-b4a2-fe2f6f4a889c DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] deleating volume v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] get snapshots for volume v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] get volume v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448052', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115749', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5641186431489398565', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b68a2ea0d5cf552b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227798016', 'san:volume_id': 'b68a2ea0d5cf552b5965f17c552f7b59d49f8de4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88617', 'name': 'v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] delete volume:v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] volume v_216125a5-7d33-4a95-b4a2-fe2f6f4a889c deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] remove_export for volume: eabdf280-b286-457b-8592-f056805c5a3b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1633777313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=144c2429-5dcf-42e2-bd55-730bdb60bfcb,host='user@joviandss-2#joviandss-2',id=eabdf280-b286-457b-8592-f056805c5a3b,launched_at=2023-04-14T04:30:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6979d1df354918895f426dc68ef514',provider_auth='CHAP eNzkWBPc MrB3tsyTYX9bna',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:30:49Z,use_quota=True,user_id='58bcced0f2194b38b14eabf952c49471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d45e47b-6ca6-4b65-912e-cdc23e33fd05),volume_type_id=7d45e47b-6ca6-4b65-912e-cdc23e33fd05) from target:iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] detach volume v_eabdf280-b286-457b-8592-f056805c5a3b from target iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b/luns/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b/luns/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b/luns/v_eabdf280-b286-457b-8592-f056805c5a3b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b/luns/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] failed to remove resource iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b because of JDSS resource v_eabdf280-b286-457b-8592-f056805c5a3b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] delete target: iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] delete target iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] failed to remove resource iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b because of JDSS resource iqn.2010-10.org.openstack:eabdf280-b286-457b-8592-f056805c5a3b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] deleating volume v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] get snapshots for volume v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] get volume v_eabdf280-b286-457b-8592-f056805c5a3b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eabdf280-b286-457b-8592-f056805c5a3b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448050', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115745', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6750475151501275365', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '068626efe1a065e6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227879936', 'san:volume_id': '068626efe1a065e6e056c7016b272de9903da18b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88608', 'name': 'v_eabdf280-b286-457b-8592-f056805c5a3b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] delete volume:v_eabdf280-b286-457b-8592-f056805c5a3b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (c1c095b9-f72e-4311-81c1-d19f9147ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9275569-5b39-4ae2-8c6f-efd79c727fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9275569-5b39-4ae2-8c6f-efd79c727fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e9e63107-a32f-4221-964d-9ee193d260fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5cc0b68-6502-4a55-96a0-69a8f27c433c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:30:52Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642b1fa8-097f-4cf6-8953-91cbf88c7453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642b1fa8-097f-4cf6-8953-91cbf88c7453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba9158-d5fb-4944-aa00-d2cad0211ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba9158-d5fb-4944-aa00-d2cad0211ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9e63107-a32f-4221-964d-9ee193d260fb', 'volume_name': 'volume-e9e63107-a32f-4221-964d-9ee193d260fb', 'volume_size': 1, 'snapshot_id': 'f5cc0b68-6502-4a55-96a0-69a8f27c433c'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab5dd65-bdc0-42d9-a547-88a3201550ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab5dd65-bdc0-42d9-a547-88a3201550ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6477497a-0ca1-4694-95de-7e4bbf02170e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:51 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Volume e9e63107-a32f-4221-964d-9ee193d260fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9e63107-a32f-4221-964d-9ee193d260fb', 'volume_size': 1, 'snapshot_id': 'f5cc0b68-6502-4a55-96a0-69a8f27c433c'} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] create volume e9e63107-a32f-4221-964d-9ee193d260fb from snapshot f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] cloning s_f5cc0b68-6502-4a55-96a0-69a8f27c433c to v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] create snapshot v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e9e63107-a32f-4221-964d-9ee193d260fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] create volume v_e9e63107-a32f-4221-964d-9ee193d260fb from snapshot v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eabdf280-b286-457b-8592-f056805c5a3b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] volume v_eabdf280-b286-457b-8592-f056805c5a3b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.quota [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Created reservations ['b248fa3c-45a0-454a-86ee-5a1b03f6e3b2'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:53 user cinder-volume[73393]: WARNING cinder.quota [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-549135710 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-549135710, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:30:53 user cinder-volume[73393]: WARNING cinder.quota [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-549135710 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-549135710, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.quota [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Created reservations ['51ffa83d-9db7-4e76-a2ea-29ae3f1514a1', '2e0f9444-b59d-4d38-bf63-0b678e9bcd8d', '51838bcd-cb38-4643-a0b3-8a64303e2fb2', 'cf7fc156-81ce-4897-8ad5-5acc5a39e034'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=10,cinder:SELECT=66,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=25,cinder:SELECT=62,cinder:DELETE=1,cinder:INSERT=12 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.quota [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Created reservations ['6c6a51ac-e95f-4e5d-a211-6e87146e900c', '933cb2c2-ab3a-4eb9-b871-709672de9b7d', '2feab502-0bdd-4559-877d-d80b6ca7fc7f', '90fddd85-f32e-4b84-9566-44332215edc7'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c@v_e9e63107-a32f-4221-964d-9ee193d260fb', 'is_clone': True, 'full_name': 'Pool-0/v_e9e63107-a32f-4221-964d-9ee193d260fb', 'name': 'v_e9e63107-a32f-4221-964d-9ee193d260fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] get volume v_e9e63107-a32f-4221-964d-9ee193d260fb info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c@v_e9e63107-a32f-4221-964d-9ee193d260fb', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e9e63107-a32f-4221-964d-9ee193d260fb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448062', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26112000', 'sharesmb': None, 'createtxg': '115763', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11439285061680656892', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '815a8c70a86d7512', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227937280', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88426', 'name': 'v_e9e63107-a32f-4221-964d-9ee193d260fb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Marking volume e9e63107-a32f-4221-964d-9ee193d260fb as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Copying metadata from snapshot f5cc0b68-6502-4a55-96a0-69a8f27c433c to e9e63107-a32f-4221-964d-9ee193d260fb. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6477497a-0ca1-4694-95de-7e4bbf02170e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e63107-a32f-4221-964d-9ee193d260fb', 'volume_size': 1, 'snapshot_id': 'f5cc0b68-6502-4a55-96a0-69a8f27c433c'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944b7acc-d89e-40bd-a01c-4c18bf33ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Volume volume-e9e63107-a32f-4221-964d-9ee193d260fb (e9e63107-a32f-4221-964d-9ee193d260fb): created successfully Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944b7acc-d89e-40bd-a01c-4c18bf33ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (c1c095b9-f72e-4311-81c1-d19f9147ae36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:54 user cinder-volume[73393]: INFO cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-5dc7604d-ae98-4c3e-9202-419574eae079 tempest-TestVolumeBootPattern-1780160917 None] Created volume successfully. Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227937280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:30:54 user cinder-volume[73393]: DEBUG cinder.manager [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:30:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-91bf7829-05e5-4691-bf6d-abe786dbadaa tempest-GroupsTest-681347672 None] Delete group completed successfully. Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] create export for volume: e9e63107-a32f-4221-964d-9ee193d260fb. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] ensure volume e9e63107-a32f-4221-964d-9ee193d260fb assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] check if targe iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] create target and attach volume e9e63107-a32f-4221-964d-9ee193d260fb to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] create target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:30:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-45234e13-83a3-4de5-b7a9-0ea305dd76c0 tempest-GroupsV314Test-1643040580 None] Group tempest-GroupsV314Test-Group-903177449: creating Apr 14 04:30:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-45234e13-83a3-4de5-b7a9-0ea305dd76c0 tempest-GroupsV314Test-1643040580 None] Group tempest-GroupsV314Test-Group-903177449: created successfully Apr 14 04:30:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-45234e13-83a3-4de5-b7a9-0ea305dd76c0 tempest-GroupsV314Test-1643040580 None] Create group completed successfully. Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Flow 'volume_create_manager' (7917cc9d-f75b-45ae-a4fd-5cb9c4f18b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a810d-14c3-4a9f-acd2-01377e7e02fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a810d-14c3-4a9f-acd2-01377e7e02fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-256055283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b1fac5d-b274-46c4-9db2-e366828315da,host='user@joviandss-2#joviandss-2',id=b2fb8087-b634-48f0-a22e-e1b6a29c7385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1abc7b736e748b2af70dc3eaeb974c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:30:59Z,use_quota=True,user_id='92e9f678430841a5bedf1dd9770ce36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8197c2d-30a0-4e28-9168-e9f06ee03d2f),volume_type_id=d8197c2d-30a0-4e28-9168-e9f06ee03d2f)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892e3717-896a-480b-bd1d-7cf99cb29c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892e3717-896a-480b-bd1d-7cf99cb29c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc2919-f162-46f1-bdf3-2f1e1fba2468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc2919-f162-46f1-bdf3-2f1e1fba2468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'volume_name': 'volume-b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05417ab2-61e5-4c7d-937d-797f281e2b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05417ab2-61e5-4c7d-937d-797f281e2b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b5bbb3-730d-4771-83df-6ecf1d7bf635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:30:59 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Volume b2fb8087-b634-48f0-a22e-e1b6a29c7385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'volume_size': 1} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] creating volume v_b2fb8087-b634-48f0-a22e-e1b6a29c7385. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] create volume {'name': 'v_b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:30:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] atach volume v_e9e63107-a32f-4221-964d-9ee193d260fb to target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] terminate connection for 2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:31:00 user cinder-volume[73393]: INFO cinder.volume.manager [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Terminate volume connection completed successfully. Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Deleting attachment e2a40397-a048-409f-b16d-fcaf23668422. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] remove_export for volume: 2ea04249-09da-471f-a8b5-89a901381329. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1287411734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2ea04249-09da-471f-a8b5-89a901381329,launched_at=2023-04-14T04:25:12Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='33320dc2f2c14ecfa5abf6574029c36c',provider_auth='CHAP dWfGZPuJ IkOp4ZAh9nad0g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:11Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:30:59Z,use_quota=True,user_id='5234914aec8e443b8a38ac6b38729031',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] detach volume v_2ea04249-09da-471f-a8b5-89a901381329 from target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'is_clone': False, 'name': 'v_b2fb8087-b634-48f0-a22e-e1b6a29c7385'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b5bbb3-730d-4771-83df-6ecf1d7bf635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581bbbdf-0f0f-4920-b044-8c3cb7568ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:00 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Volume volume-b2fb8087-b634-48f0-a22e-e1b6a29c7385 (b2fb8087-b634-48f0-a22e-e1b6a29c7385): created successfully Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581bbbdf-0f0f-4920-b044-8c3cb7568ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Flow 'volume_create_manager' (7917cc9d-f75b-45ae-a4fd-5cb9c4f18b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7aa0a711-3f27-4335-98c7-f91b9d07f925 tempest-GroupsV314Test-1643040580 None] Created volume successfully. Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] delete target: iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] delete target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-71f502c4-224b-46fa-a25f-17ec0650a7df req-51637883-193c-4a08-b7e2-5023d46ad9d2 tempest-ServerRescueNegativeTestJSON-508041341 None] target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3831356138633730', 'lun': 0, 'mode': 'wt', 'name': 'v_e9e63107-a32f-4221-964d-9ee193d260fb', 'prod_id': 'Storage', 'scsi_id': '815a8c70a86d7512'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] add credentails to target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'name': 'qBXmfngt'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] initialize_connection for e9e63107-a32f-4221-964d-9ee193d260fb 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBXmfngt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0f9216d9-463d-4546-b8b1-f30bf5bac3d6'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:31:01 user cinder-volume[73393]: INFO cinder.volume.manager [req-c1c3b813-732c-43ca-93eb-102f507975fb req-f30da6b3-df90-4663-81a1-29f053239c11 tempest-TestVolumeBootPattern-1780160917 None] attachment_update completed successfully. Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] cloned volume b2fb8087-b634-48f0-a22e-e1b6a29c7385 to e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] cloning v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 to v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] create snapshot v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e966c9ef-3251-43dd-a789-c1e0c8501cb9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] create volume v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 from snapshot v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:31:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385@v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'is_clone': True, 'full_name': 'Pool-0/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'name': 'v_e966c9ef-3251-43dd-a789-c1e0c8501cb9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] get volume v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385@v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448072', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115778', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8351790585919838448', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '486f4cbd50575744', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227806208', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88629', 'name': 'v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:04 user cinder-volume[73393]: INFO cinder.volume.manager [None req-166ece7a-8de4-4ff1-9cf5-9cee91a11937 tempest-GroupsV314Test-1643040580 None] Create group from source-group-9b1fac5d-b274-46c4-9db2-e366828315da completed successfully. Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] remove_export for volume: e966c9ef-3251-43dd-a789-c1e0c8501cb9. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86b21a5e-b234-473c-854a-17ee100163aa,host='user@joviandss-2#joviandss-2',id=e966c9ef-3251-43dd-a789-c1e0c8501cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1abc7b736e748b2af70dc3eaeb974c2',provider_auth='CHAP MqrLcaXH jTxFGHhsrPAtyl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b2fb8087-b634-48f0-a22e-e1b6a29c7385,status='deleting',terminated_at=None,updated_at=2023-04-14T04:31:05Z,use_quota=True,user_id='92e9f678430841a5bedf1dd9770ce36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8197c2d-30a0-4e28-9168-e9f06ee03d2f),volume_type_id=d8197c2d-30a0-4e28-9168-e9f06ee03d2f) from target:iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] detach volume v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 from target iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9/luns/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9/luns/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9/luns/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9/luns/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] failed to remove resource iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 because of JDSS resource v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] delete target: iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] delete target iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] failed to remove resource iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 because of JDSS resource iqn.2010-10.org.openstack:e966c9ef-3251-43dd-a789-c1e0c8501cb9 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] deleating volume v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] get snapshots for volume v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] get volume v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385@v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448072', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115778', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8351790585919838448', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '486f4cbd50575744', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227793920', 'san:volume_id': '486f4cbd5057574411cfa3f1e36cd7eba41e1a65', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88629', 'name': 'v_e966c9ef-3251-43dd-a789-c1e0c8501cb9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] delete snapshot v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 of volume v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots/v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] snapshot v_e966c9ef-3251-43dd-a789-c1e0c8501cb9 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.quota [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Created reservations ['bc009d21-49c7-4144-b878-701544ac401b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:07 user cinder-volume[73393]: WARNING cinder.quota [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-86521728 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-86521728, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:31:07 user cinder-volume[73393]: WARNING cinder.quota [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-86521728 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-86521728, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:31:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=22,cinder:SELECT=69,cinder:INSERT=7,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.quota [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Created reservations ['704e36cd-639f-4ccb-86a8-601f18be7b50', '0092d7e8-6c17-4b60-974a-cd749a0e0a5b', 'a875601b-f9c5-4415-acb4-373d1876cea4', '5a0f508a-b33c-4a92-99d8-fba977b5450a'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=59,cinder:UPDATE=30,cinder:INSERT=11 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227781632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.manager [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-89c75ac9-90ec-4a3c-afb6-036bcd47547a tempest-GroupsV314Test-1643040580 None] Delete group completed successfully. Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] remove_export for volume: b2fb8087-b634-48f0-a22e-e1b6a29c7385. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-256055283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b1fac5d-b274-46c4-9db2-e366828315da,host='user@joviandss-2#joviandss-2',id=b2fb8087-b634-48f0-a22e-e1b6a29c7385,launched_at=2023-04-14T04:31:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1abc7b736e748b2af70dc3eaeb974c2',provider_auth='CHAP fOyUzvHW xfl0UpsvCrdEZI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:59Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:31:08Z,use_quota=True,user_id='92e9f678430841a5bedf1dd9770ce36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8197c2d-30a0-4e28-9168-e9f06ee03d2f),volume_type_id=d8197c2d-30a0-4e28-9168-e9f06ee03d2f) from target:iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] detach volume v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 from target iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385/luns/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385/luns/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385/luns/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385/luns/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] failed to remove resource iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 because of JDSS resource v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] delete target: iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] delete target iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] failed to remove resource iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 because of JDSS resource iqn.2010-10.org.openstack:b2fb8087-b634-48f0-a22e-e1b6a29c7385 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] deleating volume v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] get snapshots for volume v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] get volume v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448068', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115768', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9481499869711828309', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '75e2e86a90aae92e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227781632', 'san:volume_id': '75e2e86a90aae92ebc8de8d2221cca6c86502e50', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88802', 'name': 'v_b2fb8087-b634-48f0-a22e-e1b6a29c7385', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] delete volume:v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] volume v_b2fb8087-b634-48f0-a22e-e1b6a29c7385 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.quota [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Created reservations ['3acbec7a-80ba-4e10-af7a-567e7a54b5a9'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.quota [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Created reservations ['c8eeff4e-14eb-4ea2-acc6-a9db73817d38', 'e284d025-3e52-4205-8803-fbb414ef3aa6', '3ac1f86c-fb42-4a46-98d9-e3486b9f9bb9', 'ea5bf816-d858-4084-9438-f8d29bf00b9e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227863552', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:11 user cinder-volume[73393]: DEBUG cinder.manager [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:11 user cinder-volume[73393]: INFO cinder.volume.manager [None req-39b1b174-e1cc-42d7-a717-33580fcc889d tempest-GroupsV314Test-1643040580 None] Delete group completed successfully. Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Flow 'volume_create_manager' (c39bd65d-2d90-4942-9e76-47d51598e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c803e100-1524-4e18-a7b3-ef651ba560ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c803e100-1524-4e18-a7b3-ef651ba560ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1574674830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=699ced9c-e876-4fe2-b824-1d5c329284cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e6f2c1773b41eeb86ca1cbb2fedbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:16Z,use_quota=True,user_id='21a6e4c89b294581bb6b17c04705cc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb733226-ff42-4a50-89e6-023e7214c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb733226-ff42-4a50-89e6-023e7214c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2992d7b5-e63a-499a-ae83-3a34bf1e7459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2992d7b5-e63a-499a-ae83-3a34bf1e7459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699ced9c-e876-4fe2-b824-1d5c329284cb', 'volume_name': 'volume-699ced9c-e876-4fe2-b824-1d5c329284cb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a0c92-0a49-499d-bf7f-17740de31215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a0c92-0a49-499d-bf7f-17740de31215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca26366-f807-4eed-9bc8-b13c5f227aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:15 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Volume 699ced9c-e876-4fe2-b824-1d5c329284cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699ced9c-e876-4fe2-b824-1d5c329284cb', 'volume_size': 1} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] creating volume v_699ced9c-e876-4fe2-b824-1d5c329284cb. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] create volume {'name': 'v_699ced9c-e876-4fe2-b824-1d5c329284cb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_699ced9c-e876-4fe2-b824-1d5c329284cb', 'is_clone': False, 'name': 'v_699ced9c-e876-4fe2-b824-1d5c329284cb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca26366-f807-4eed-9bc8-b13c5f227aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699ced9c-e876-4fe2-b824-1d5c329284cb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f4875-2aaf-490f-975a-1df1166dae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Volume volume-699ced9c-e876-4fe2-b824-1d5c329284cb (699ced9c-e876-4fe2-b824-1d5c329284cb): created successfully Apr 14 04:31:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f4875-2aaf-490f-975a-1df1166dae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Flow 'volume_create_manager' (c39bd65d-2d90-4942-9e76-47d51598e96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-404251b2-909d-4c9c-a66a-30e9dbd92886 tempest-VolumesTransfersTest-1032579764 None] Created volume successfully. Apr 14 04:31:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e11174c9-d5cd-4625-9947-4612dccfd568 tempest-VolumesTransfersTest-1251905615 None] Transfer volume completed successfully. Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Acquiring lock "cinder-699ced9c-e876-4fe2-b824-1d5c329284cb-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Lock "cinder-699ced9c-e876-4fe2-b824-1d5c329284cb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] remove_export for volume: 699ced9c-e876-4fe2-b824-1d5c329284cb. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1574674830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=699ced9c-e876-4fe2-b824-1d5c329284cb,launched_at=2023-04-14T04:31:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48a5baca2fb44ea1995eb9e4b0d91f06',provider_auth='CHAP VefEbmFA JF4eCaYKw0GSfN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:16Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:19Z,updated_at=2023-04-14T04:31:19Z,use_quota=True,user_id='a7e71829b163475d90421218e21333e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] detach volume v_699ced9c-e876-4fe2-b824-1d5c329284cb from target iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb/luns/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb/luns/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb/luns/v_699ced9c-e876-4fe2-b824-1d5c329284cb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb/luns/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] failed to remove resource iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb because of JDSS resource v_699ced9c-e876-4fe2-b824-1d5c329284cb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] delete target: iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] delete target iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] failed to remove resource iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb because of JDSS resource iqn.2010-10.org.openstack:699ced9c-e876-4fe2-b824-1d5c329284cb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] deleating volume v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] get snapshots for volume v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] get volume v_699ced9c-e876-4fe2-b824-1d5c329284cb info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_699ced9c-e876-4fe2-b824-1d5c329284cb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448085', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115787', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15460484123822322795', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3f17fb4d58f59b40', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227621888', 'san:volume_id': '3f17fb4d58f59b40b964b95b08cc23675e5af0c0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87655', 'name': 'v_699ced9c-e876-4fe2-b824-1d5c329284cb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] delete volume:v_699ced9c-e876-4fe2-b824-1d5c329284cb recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_699ced9c-e876-4fe2-b824-1d5c329284cb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] volume v_699ced9c-e876-4fe2-b824-1d5c329284cb deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:31:21 user cinder-volume[73393]: DEBUG cinder.quota [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Created reservations ['683b6c4f-f243-49e3-80c4-7dc04a37265f', '5d8268b5-de9a-4cc9-9350-f66259fa83ed', 'def192fe-cad5-48b7-85e4-0256a7cec9c0', 'b08f208a-bac5-4ba1-adc7-477d0c2d730e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227572736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.manager [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:22 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Deleted volume successfully. Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d6b484b9-818f-4fef-b940-093053fd5920 tempest-VolumesTransfersTest-1182458963 None] Lock "cinder-699ced9c-e876-4fe2-b824-1d5c329284cb-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Flow 'volume_create_manager' (9d4bc540-6f0e-4025-9a24-d83a831f593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070364bf-2487-4c86-98e7-cc510b69c7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070364bf-2487-4c86-98e7-cc510b69c7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-256970072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b04fe5a3-f1b0-4d97-a153-c3241aef9abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e6f2c1773b41eeb86ca1cbb2fedbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:23Z,use_quota=True,user_id='21a6e4c89b294581bb6b17c04705cc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54981002-80a7-46b9-ae8f-4b74ba7edd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54981002-80a7-46b9-ae8f-4b74ba7edd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6214a4-5501-41ff-a7a6-a17bbbc22d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6214a4-5501-41ff-a7a6-a17bbbc22d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'volume_name': 'volume-b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce1e684-1c56-4954-87f4-b671257a6596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce1e684-1c56-4954-87f4-b671257a6596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53300580-7a8f-4e40-92d9-36cfd08fefbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:22 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Volume b04fe5a3-f1b0-4d97-a153-c3241aef9abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'volume_size': 1} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] creating volume v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] create volume {'name': 'v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'is_clone': False, 'name': 'v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53300580-7a8f-4e40-92d9-36cfd08fefbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abebeb4-5956-4f07-b9df-5431a0bd4b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:23 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Volume volume-b04fe5a3-f1b0-4d97-a153-c3241aef9abb (b04fe5a3-f1b0-4d97-a153-c3241aef9abb): created successfully Apr 14 04:31:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abebeb4-5956-4f07-b9df-5431a0bd4b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Flow 'volume_create_manager' (9d4bc540-6f0e-4025-9a24-d83a831f593b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ea5947f5-38ba-405e-9d81-9ec1022a4d00 tempest-VolumesTransfersTest-1032579764 None] Created volume successfully. Apr 14 04:31:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:31:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Acquiring lock "cinder-b04fe5a3-f1b0-4d97-a153-c3241aef9abb-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Lock "cinder-b04fe5a3-f1b0-4d97-a153-c3241aef9abb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] remove_export for volume: b04fe5a3-f1b0-4d97-a153-c3241aef9abb. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-256970072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b04fe5a3-f1b0-4d97-a153-c3241aef9abb,launched_at=2023-04-14T04:31:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e6f2c1773b41eeb86ca1cbb2fedbbb',provider_auth='CHAP HmGeiCIJ 0yqaAxDsTpgYBn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:23Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:25Z,updated_at=2023-04-14T04:31:25Z,use_quota=True,user_id='21a6e4c89b294581bb6b17c04705cc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] detach volume v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb from target iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb/luns/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb/luns/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb/luns/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb/luns/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] failed to remove resource iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb because of JDSS resource v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] delete target: iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] delete target iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] failed to remove resource iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb because of JDSS resource iqn.2010-10.org.openstack:b04fe5a3-f1b0-4d97-a153-c3241aef9abb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] deleating volume v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] get snapshots for volume v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114227503104', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] get volume v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448092', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115793', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17806676461093802179', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd0badfcf2d556f3a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227503104', 'san:volume_id': 'd0badfcf2d556f3a0c4a10024f46cbc1d81702eb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87670', 'name': 'v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] delete volume:v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] volume v_b04fe5a3-f1b0-4d97-a153-c3241aef9abb deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=32,cinder:SELECT=59,cinder:INSERT=7,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG cinder.quota [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Created reservations ['345d4233-dba9-460d-af33-5ad24c72302f', 'e03014e6-e687-4298-89d2-f2af75a8854a', 'f3788661-bf65-4dc4-8198-a0aed6ec5f42', 'e3cbd516-9eac-40a6-a9d3-0d4c15ab90cd'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227572736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:30 user cinder-volume[73393]: DEBUG cinder.manager [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Deleted volume successfully. Apr 14 04:31:30 user cinder-volume[73393]: DEBUG cinder.coordination [None req-07bf0617-5ee2-408d-baf6-eeb0371faa50 tempest-VolumesTransfersTest-1182458963 None] Lock "cinder-b04fe5a3-f1b0-4d97-a153-c3241aef9abb-delete_volume" released by "delete_volume" :: held 5.450s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:31:34 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (5458eb08-ce8b-4863-8743-d46643eaf7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48718815-9761-4cc1-8f81-32453815ec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48718815-9761-4cc1-8f81-32453815ec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-954672046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:35Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c8aef5-cd73-4be1-b0cd-3d93c70ddcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c8aef5-cd73-4be1-b0cd-3d93c70ddcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653ac117-55cb-4e47-b255-ca22e7937c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653ac117-55cb-4e47-b255-ca22e7937c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'volume_name': 'volume-75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03b9d31-81f7-4e46-9407-d6112ae95bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03b9d31-81f7-4e46-9407-d6112ae95bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe4df12-0f24-44a1-ae15-5a7127c8c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume 75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'volume_size': 1} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] creating volume v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] create volume {'name': 'v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'is_clone': False, 'name': 'v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe4df12-0f24-44a1-ae15-5a7127c8c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e1022-28ce-41bc-a719-4ee06e26d033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:36 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume volume-75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc (75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc): created successfully Apr 14 04:31:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e1022-28ce-41bc-a719-4ee06e26d033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (5458eb08-ce8b-4863-8743-d46643eaf7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b667c9ac-363d-429a-a917-43f09e200d47 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created volume successfully. Apr 14 04:31:36 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=53,cinder:INSERT=6,cinder:UPDATE=39,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] create snapshot 29973de9-6ab0-4a83-a309-8fcd9fbc7858 for volume 75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:31:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] cloning v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc to s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:31:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] create snapshot s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:31:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_29973de9-6ab0-4a83-a309-8fcd9fbc7858'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] create volume s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 from snapshot s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:31:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc@s_29973de9-6ab0-4a83-a309-8fcd9fbc7858', 'is_clone': True, 'full_name': 'Pool-0/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858', 'name': 's_29973de9-6ab0-4a83-a309-8fcd9fbc7858'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] volume s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:31:39 user cinder-volume[73393]: INFO cinder.volume.manager [None req-88870b25-f59c-495c-8588-6120b03e2ed5 tempest-CreateVolumesFromSnapshotTest-870665439 None] Create snapshot completed successfully Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (16a66cf4-37da-45ce-a43a-7477a8b2f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff64f43b-5528-4eaa-971c-9f692263d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff64f43b-5528-4eaa-971c-9f692263d03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1035435374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a6c3eb6d-0f7d-497e-99cd-bbb917106aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:41Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443376a1-7807-4108-ae07-44096aebfee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443376a1-7807-4108-ae07-44096aebfee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c3e6ba-4710-4e8a-afde-ce47fe73ed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c3e6ba-4710-4e8a-afde-ce47fe73ed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'volume_name': 'volume-a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4440a3b6-9bc6-43ac-8df3-5115bc206033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4440a3b6-9bc6-43ac-8df3-5115bc206033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6961b96b-bc68-4720-982f-1b9495909dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume a6c3eb6d-0f7d-497e-99cd-bbb917106aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'volume_size': 1} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] creating volume v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] create volume {'name': 'v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (88bb6580-716d-443e-bba8-c1aa60924876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de187751-a33c-437e-8162-7fc58b7da081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de187751-a33c-437e-8162-7fc58b7da081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1278132697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=76caae17-f19f-4e7c-8673-ccf848f30b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:41Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cc3f4c-262e-4809-a9e7-d3e2cf95aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cc3f4c-262e-4809-a9e7-d3e2cf95aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115653a-468f-4d7e-ade4-18eb52471dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115653a-468f-4d7e-ade4-18eb52471dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76caae17-f19f-4e7c-8673-ccf848f30b2d', 'volume_name': 'volume-76caae17-f19f-4e7c-8673-ccf848f30b2d', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d08794-0f66-4ee5-a0fa-ec4d0b599426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d08794-0f66-4ee5-a0fa-ec4d0b599426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4c87db-0eb5-41f3-9431-2b39c295eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:40 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume 76caae17-f19f-4e7c-8673-ccf848f30b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76caae17-f19f-4e7c-8673-ccf848f30b2d', 'volume_size': 1} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] creating volume v_76caae17-f19f-4e7c-8673-ccf848f30b2d. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] create volume {'name': 'v_76caae17-f19f-4e7c-8673-ccf848f30b2d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (9b205ea4-ad79-4e19-a3fb-0a9c40b24bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b384574-f2de-4858-a60e-2c3bdd42680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b384574-f2de-4858-a60e-2c3bdd42680b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532839918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=512efe20-5370-472f-9bfa-b2f9cb9e7b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:41Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a7bee6-718f-4ad1-bfa2-71850ae5722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a7bee6-718f-4ad1-bfa2-71850ae5722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253b655f-98bb-41b1-8bd1-db2601833798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253b655f-98bb-41b1-8bd1-db2601833798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'volume_name': 'volume-512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17899d7f-41ef-4e42-98c7-9fc1fef1d84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17899d7f-41ef-4e42-98c7-9fc1fef1d84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ccdfd2-771a-407e-b1ec-f8b8d8ea758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume 512efe20-5370-472f-9bfa-b2f9cb9e7b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'volume_size': 1} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] creating volume v_512efe20-5370-472f-9bfa-b2f9cb9e7b51. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] create volume {'name': 'v_512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (eb5df06a-5279-424f-b1ab-b9dc707c7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1289679-f1ba-4d76-8c8e-72120e261799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1289679-f1ba-4d76-8c8e-72120e261799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141345283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bb2685dd-ffb3-4939-b27c-417c6bc592e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:42Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd758bf-2a63-4a1a-9a22-e8b726360cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd758bf-2a63-4a1a-9a22-e8b726360cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b50f33-1b04-47de-9a1d-06fb21940707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b50f33-1b04-47de-9a1d-06fb21940707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'volume_name': 'volume-bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36b0953-fc62-4659-a0d5-bd201fc8f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36b0953-fc62-4659-a0d5-bd201fc8f552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92066a2f-edd0-4973-8cd9-66986a7a4fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume bb2685dd-ffb3-4939-b27c-417c6bc592e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'volume_size': 1} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] creating volume v_bb2685dd-ffb3-4939-b27c-417c6bc592e4. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] create volume {'name': 'v_bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (82d0a58a-524b-4647-9945-ed597888ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fe575b-b543-4780-b7e2-fd1f9ef2ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fe575b-b543-4780-b7e2-fd1f9ef2ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466218993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5168b722-5954-42e9-b936-c240e69c8414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:31:42Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b565759-45e0-4c95-b073-2a4f0126250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b565759-45e0-4c95-b073-2a4f0126250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47ffa99-698d-4a29-9256-12b701fca6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47ffa99-698d-4a29-9256-12b701fca6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5168b722-5954-42e9-b936-c240e69c8414', 'volume_name': 'volume-5168b722-5954-42e9-b936-c240e69c8414', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f314848-ad1f-4f39-ba86-4493f595ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f314848-ad1f-4f39-ba86-4493f595ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d027bac-1619-4e36-bb6e-ebe67c248d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume 5168b722-5954-42e9-b936-c240e69c8414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5168b722-5954-42e9-b936-c240e69c8414', 'volume_size': 1} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] creating volume v_5168b722-5954-42e9-b936-c240e69c8414. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] create volume {'name': 'v_5168b722-5954-42e9-b936-c240e69c8414', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'is_clone': False, 'name': 'v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_76caae17-f19f-4e7c-8673-ccf848f30b2d', 'is_clone': False, 'name': 'v_76caae17-f19f-4e7c-8673-ccf848f30b2d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4c87db-0eb5-41f3-9431-2b39c295eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76caae17-f19f-4e7c-8673-ccf848f30b2d', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8bae73-cdfd-4b64-aa55-b96544be67aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6961b96b-bc68-4720-982f-1b9495909dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261438b1-3787-48f0-8e91-5397c534dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume volume-76caae17-f19f-4e7c-8673-ccf848f30b2d (76caae17-f19f-4e7c-8673-ccf848f30b2d): created successfully Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8bae73-cdfd-4b64-aa55-b96544be67aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (88bb6580-716d-443e-bba8-c1aa60924876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5a99b8d6-1723-4f01-9bdb-b3bfcddb0f17 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created volume successfully. Apr 14 04:31:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume volume-a6c3eb6d-0f7d-497e-99cd-bbb917106aef (a6c3eb6d-0f7d-497e-99cd-bbb917106aef): created successfully Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261438b1-3787-48f0-8e91-5397c534dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (16a66cf4-37da-45ce-a43a-7477a8b2f231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d17454b8-0b79-4963-9b14-4696fe751371 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created volume successfully. Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'is_clone': False, 'name': 'v_bb2685dd-ffb3-4939-b27c-417c6bc592e4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92066a2f-edd0-4973-8cd9-66986a7a4fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2185dcf-00d2-481d-ae78-bee472aa9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume volume-bb2685dd-ffb3-4939-b27c-417c6bc592e4 (bb2685dd-ffb3-4939-b27c-417c6bc592e4): created successfully Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2185dcf-00d2-481d-ae78-bee472aa9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (eb5df06a-5279-424f-b1ab-b9dc707c7625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:43 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a4d44a0f-6c3a-4203-859a-f477ab5404c3 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created volume successfully. Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5168b722-5954-42e9-b936-c240e69c8414', 'is_clone': False, 'name': 'v_5168b722-5954-42e9-b936-c240e69c8414'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d027bac-1619-4e36-bb6e-ebe67c248d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5168b722-5954-42e9-b936-c240e69c8414', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8841fc-f4e8-4d54-9edb-4ee066aae8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:43 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume volume-5168b722-5954-42e9-b936-c240e69c8414 (5168b722-5954-42e9-b936-c240e69c8414): created successfully Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8841fc-f4e8-4d54-9edb-4ee066aae8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (82d0a58a-524b-4647-9945-ed597888ff15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:43 user cinder-volume[73393]: INFO cinder.volume.manager [None req-515aa291-506a-4b97-9282-d52bd4320cbe tempest-CreateVolumesFromSnapshotTest-870665439 None] Created volume successfully. Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'is_clone': False, 'name': 'v_512efe20-5370-472f-9bfa-b2f9cb9e7b51'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ccdfd2-771a-407e-b1ec-f8b8d8ea758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ddd99-98ed-4bad-b9ea-ac066a793fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:31:43 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Volume volume-512efe20-5370-472f-9bfa-b2f9cb9e7b51 (512efe20-5370-472f-9bfa-b2f9cb9e7b51): created successfully Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ddd99-98ed-4bad-b9ea-ac066a793fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:31:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Flow 'volume_create_manager' (9b205ea4-ad79-4e19-a3fb-0a9c40b24bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:31:43 user cinder-volume[73393]: INFO cinder.volume.manager [None req-91c49628-506b-48d2-8145-a82dd1247508 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created volume successfully. Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Acquiring lock "cinder-5168b722-5954-42e9-b936-c240e69c8414-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-5168b722-5954-42e9-b936-c240e69c8414-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] remove_export for volume: 5168b722-5954-42e9-b936-c240e69c8414. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466218993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5168b722-5954-42e9-b936-c240e69c8414,launched_at=2023-04-14T04:31:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth='CHAP rFgjVhOn B5sUF47D8MxXER',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:42Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:44Z,updated_at=2023-04-14T04:31:44Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume v_5168b722-5954-42e9-b936-c240e69c8414 from target iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414/luns/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414/luns/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414/luns/v_5168b722-5954-42e9-b936-c240e69c8414'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414/luns/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 because of JDSS resource v_5168b722-5954-42e9-b936-c240e69c8414 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target: iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 because of JDSS resource iqn.2010-10.org.openstack:5168b722-5954-42e9-b936-c240e69c8414 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] deleating volume v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] get snapshots for volume v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] get volume v_5168b722-5954-42e9-b936-c240e69c8414 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5168b722-5954-42e9-b936-c240e69c8414', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448111', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115820', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8007368024289313812', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '17931e5634610ae4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227044352', 'san:volume_id': '17931e5634610ae4e80d7d01de7525967ecce0a3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89676', 'name': 'v_5168b722-5954-42e9-b936-c240e69c8414', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] delete volume:v_5168b722-5954-42e9-b936-c240e69c8414 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5168b722-5954-42e9-b936-c240e69c8414 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] volume v_5168b722-5954-42e9-b936-c240e69c8414 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.quota [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Created reservations ['fcf52868-c23a-4262-8db0-7c3c3b415c21', '1b119696-c71c-4242-8239-dfb274c67ff6', '1999bb56-f279-421c-bfcd-21eb313b7096', '6e9f0961-cdd8-4943-84e1-cdf4bf936737'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Acquiring lock "cinder-bb2685dd-ffb3-4939-b27c-417c6bc592e4-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-bb2685dd-ffb3-4939-b27c-417c6bc592e4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove_export for volume: bb2685dd-ffb3-4939-b27c-417c6bc592e4. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141345283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bb2685dd-ffb3-4939-b27c-417c6bc592e4,launched_at=2023-04-14T04:31:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth='CHAP MgTEUyQK tzaxMcAWbYiKXR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:42Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:48Z,updated_at=2023-04-14T04:31:48Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 from target iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4/luns/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4/luns/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227126272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.manager [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:47 user cinder-volume[73393]: INFO cinder.volume.manager [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Deleted volume successfully. Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4/luns/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4/luns/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 because of JDSS resource v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target: iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bb491a7b-17d2-4703-bb21-b5433a4bf94a tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-5168b722-5954-42e9-b936-c240e69c8414-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 because of JDSS resource iqn.2010-10.org.openstack:bb2685dd-ffb3-4939-b27c-417c6bc592e4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] deleating volume v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] get snapshots for volume v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] get volume v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448111', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115817', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '112045004706942232', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '000327f9c4ac446d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227126272', 'san:volume_id': '000327f9c4ac446d1a3f0f6c0392d9ef4142f2d6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89668', 'name': 'v_bb2685dd-ffb3-4939-b27c-417c6bc592e4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete volume:v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] volume v_bb2685dd-ffb3-4939-b27c-417c6bc592e4 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.quota [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created reservations ['87be33b6-630f-4cb7-95a7-85c491505086', '134d1606-cb08-48d6-83ea-852abc287e69', '524a83c2-a529-45c3-a688-d874b9606d94', '04d27c9e-8eda-48ee-b8b2-dd87a10aa488'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Acquiring lock "cinder-512efe20-5370-472f-9bfa-b2f9cb9e7b51-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-512efe20-5370-472f-9bfa-b2f9cb9e7b51-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227204096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.manager [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:51 user cinder-volume[73393]: INFO cinder.volume.manager [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Deleted volume successfully. Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove_export for volume: 512efe20-5370-472f-9bfa-b2f9cb9e7b51. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532839918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=512efe20-5370-472f-9bfa-b2f9cb9e7b51,launched_at=2023-04-14T04:31:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth='CHAP TdCOJRBf PC56FKSbd1HtrY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:51Z,updated_at=2023-04-14T04:31:51Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 from target iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51/luns/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51/luns/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-40ad1d54-cea2-4d39-9045-5da8c7034a63 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-bb2685dd-ffb3-4939-b27c-417c6bc592e4-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51/luns/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51/luns/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 because of JDSS resource v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target: iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 because of JDSS resource iqn.2010-10.org.openstack:512efe20-5370-472f-9bfa-b2f9cb9e7b51 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] deleating volume v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] get snapshots for volume v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] get volume v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448111', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115823', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '432210522660580870', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6776d709fd470b74', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227204096', 'san:volume_id': '6776d709fd470b744175041c57d3a71ac6a16745', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89684', 'name': 'v_512efe20-5370-472f-9bfa-b2f9cb9e7b51', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete volume:v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] volume v_512efe20-5370-472f-9bfa-b2f9cb9e7b51 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:UPDATE=34,cinder:DELETE=6,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG cinder.quota [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created reservations ['ca537d48-1355-4840-934f-b7dbdf3ffec8', '288a3551-1410-405f-ada8-4451a8a2b566', '98fb5693-59ff-4050-8172-73b7dd9c88b9', '7588167c-6b2b-4d8a-843e-7232cebb5533'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Acquiring lock "cinder-76caae17-f19f-4e7c-8673-ccf848f30b2d-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-76caae17-f19f-4e7c-8673-ccf848f30b2d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove_export for volume: 76caae17-f19f-4e7c-8673-ccf848f30b2d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1278132697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=76caae17-f19f-4e7c-8673-ccf848f30b2d,launched_at=2023-04-14T04:31:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth='CHAP yBmQsiEM VkfDKAGNRPua4J',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:54Z,updated_at=2023-04-14T04:31:54Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume v_76caae17-f19f-4e7c-8673-ccf848f30b2d from target iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d/luns/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d/luns/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227261440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.manager [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Deleted volume successfully. Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cd3b9ac4-a517-48e8-853d-6df73dbc9364 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-512efe20-5370-472f-9bfa-b2f9cb9e7b51-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d/luns/v_76caae17-f19f-4e7c-8673-ccf848f30b2d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d/luns/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d because of JDSS resource v_76caae17-f19f-4e7c-8673-ccf848f30b2d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target: iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d because of JDSS resource iqn.2010-10.org.openstack:76caae17-f19f-4e7c-8673-ccf848f30b2d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] deleating volume v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] get snapshots for volume v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] get volume v_76caae17-f19f-4e7c-8673-ccf848f30b2d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_76caae17-f19f-4e7c-8673-ccf848f30b2d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448110', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115812', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13013503215610757305', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '604862b93020c445', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227261440', 'san:volume_id': '604862b93020c44523bb1164b06554deb2537a5e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89658', 'name': 'v_76caae17-f19f-4e7c-8673-ccf848f30b2d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete volume:v_76caae17-f19f-4e7c-8673-ccf848f30b2d recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] terminate connection for bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:31:55 user cinder-volume[73393]: INFO cinder.volume.manager [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Terminate volume connection completed successfully. Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Deleting attachment 481ca92d-3524-46cf-9ee5-774a508c88e2. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] remove_export for volume: bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1698950194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bcb3b184-a10d-482d-8c49-1bee42873be4,launched_at=2023-04-14T04:26:16Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='b0e15d3d3e0943c4b6bd54abf2de5fee',provider_auth='CHAP pRhHtNJB tTvXaVnGJhZjzF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:30:11Z,use_quota=True,user_id='36b6981092424de781e8403946f956d3',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] detach volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 from target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_76caae17-f19f-4e7c-8673-ccf848f30b2d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] volume v_76caae17-f19f-4e7c-8673-ccf848f30b2d deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:31:56 user cinder-volume[73393]: DEBUG cinder.quota [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created reservations ['6e050c84-99e5-49f4-bdd5-24e87c03c6aa', 'b3eb8afc-8079-4b0d-9214-e00428f53708', '8ce4301c-263d-4d67-b58e-b3dc8bb1c21d', '6b3a01f8-8439-4851-95b7-93a8f49fee65'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:31:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:31:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:31:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] delete target: iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] delete target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Acquiring lock "cinder-a6c3eb6d-0f7d-497e-99cd-bbb917106aef-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-a6c3eb6d-0f7d-497e-99cd-bbb917106aef-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] remove_export for volume: a6c3eb6d-0f7d-497e-99cd-bbb917106aef. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1035435374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a6c3eb6d-0f7d-497e-99cd-bbb917106aef,launched_at=2023-04-14T04:31:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth='CHAP FvyXnAsh kE6xj83e4lQ7mS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:58Z,updated_at=2023-04-14T04:31:58Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef from target iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef/luns/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef/luns/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef/luns/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef/luns/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef because of JDSS resource v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target: iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef because of JDSS resource iqn.2010-10.org.openstack:a6c3eb6d-0f7d-497e-99cd-bbb917106aef DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] deleating volume v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] get snapshots for volume v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227355648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.manager [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:31:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Deleted volume successfully. Apr 14 04:31:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-30dfb6b3-6a48-40eb-8b48-968d8915c418 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-76caae17-f19f-4e7c-8673-ccf848f30b2d-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-a7818c47-0656-41a7-9fb3-189c74bc0736 tempest-TestShelveInstance-1458140851 None] target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] get volume v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.coordination [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Acquiring lock "cinder-bcb3b184-a10d-482d-8c49-1bee42873be4-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.coordination [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Lock "cinder-bcb3b184-a10d-482d-8c49-1bee42873be4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448110', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115809', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7170172547258970093', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ef49965c9554929e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227355648', 'san:volume_id': 'ef49965c9554929ec75406d63d63cc407ab2e487', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89026', 'name': 'v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] delete volume:v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] remove_export for volume: bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1698950194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bcb3b184-a10d-482d-8c49-1bee42873be4,launched_at=2023-04-14T04:26:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e15d3d3e0943c4b6bd54abf2de5fee',provider_auth='CHAP pRhHtNJB tTvXaVnGJhZjzF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:26:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:31:58Z,updated_at=2023-04-14T04:31:58Z,use_quota=True,user_id='36b6981092424de781e8403946f956d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] detach volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 from target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4/luns/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] failed to remove resource iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 because of JDSS resource v_bcb3b184-a10d-482d-8c49-1bee42873be4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] delete target: iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] delete target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] failed to remove resource iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 because of JDSS resource iqn.2010-10.org.openstack:bcb3b184-a10d-482d-8c49-1bee42873be4 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] deleating volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] get snapshots for volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] get volume v_bcb3b184-a10d-482d-8c49-1bee42873be4 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447784', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '115468', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3974234238099508215', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10145792', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '1d3ba59022c2b5d2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227355648', 'san:volume_id': '1d3ba59022c2b5d25049325cdbc2f75d2fabdc06', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10145792', 'objsetid': '89366', 'name': 'v_bcb3b184-a10d-482d-8c49-1bee42873be4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10145792', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] delete snapshot v_bcb3b184-a10d-482d-8c49-1bee42873be4 of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:31:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] volume v_a6c3eb6d-0f7d-497e-99cd-bbb917106aef deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.quota [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Created reservations ['16c0b7c4-93e5-480c-b72a-464d0837cbf4', '6655352c-6e9e-4d09-b05c-b136c76424e7', 'fa09a7e5-9b24-40da-9582-e79b7ee451a2', '131c5310-bb65-4552-8648-7e9fce171ad3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_bcb3b184-a10d-482d-8c49-1bee42873be4 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] snapshot v_bcb3b184-a10d-482d-8c49-1bee42873be4 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.quota [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Created reservations ['fb5c30cf-b489-43b2-ba53-19c1f7420490', '84c5c0a6-1853-4051-acb1-288491e5ffd8', 'c130dc72-54a9-4358-9106-e46d23355523', 'd0c6b056-d503-47db-8e87-4d12be980b5e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227355648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.manager [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:00 user cinder-volume[73393]: INFO cinder.volume.manager [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Deleted volume successfully. Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.coordination [req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba req-647a413b-d018-4b71-bda9-ceca15db46c9 tempest-TestShelveInstance-1458140851 None] Lock "cinder-bcb3b184-a10d-482d-8c49-1bee42873be4-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Acquiring lock "cinder-29973de9-6ab0-4a83-a309-8fcd9fbc7858-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'available': '114237681664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.manager [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Deleted volume successfully. Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-29973de9-6ab0-4a83-a309-8fcd9fbc7858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] deleating snapshot s_29973de9-6ab0-4a83-a309-8fcd9fbc7858. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] get snapshots for volume s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-56df8505-8de7-4938-9539-3579baed683a tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-a6c3eb6d-0f7d-497e-99cd-bbb917106aef-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] get volume s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc@s_29973de9-6ab0-4a83-a309-8fcd9fbc7858', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448107', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115805', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8898331935485716424', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7698c6abd8214d8e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237681664', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89014', 'name': 's_29973de9-6ab0-4a83-a309-8fcd9fbc7858', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete snapshot s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 of volume v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots/s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] snapshot s_29973de9-6ab0-4a83-a309-8fcd9fbc7858 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:32:03 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=51,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=9 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:03 user cinder-volume[73393]: DEBUG cinder.quota [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created reservations ['d3ab0445-b792-45d9-b090-20d7ae855931', 'd7e66f02-ea83-4334-9ebd-a1594b2194ea', 'a9a0a626-860a-4993-874d-66de0bd90531', 'c584fcda-0b7f-48f2-904e-5b1f249b1545'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:03 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=30,cinder:SELECT=58,cinder:INSERT=11,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:03 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Delete snapshot completed successfully. Apr 14 04:32:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0b506091-ec09-4121-82a6-89b37177dd34 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-29973de9-6ab0-4a83-a309-8fcd9fbc7858-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Acquiring lock "cinder-75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove_export for volume: 75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-954672046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc,launched_at=2023-04-14T04:31:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc312c0d0ce84cd38fb70a2037057de1',provider_auth='CHAP ejRaFUqk 7E1oQVtvq9DbJ5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:31:35Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:32:04Z,updated_at=2023-04-14T04:32:04Z,use_quota=True,user_id='c42cefe9f094492bba52722e9903d2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] detach volume v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc from target iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/luns/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/luns/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/luns/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/luns/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc because of JDSS resource v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target: iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete target iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] failed to remove resource iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc because of JDSS resource iqn.2010-10.org.openstack:75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] deleating volume v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] get snapshots for volume v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] get volume v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448104', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115799', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7573150519478165813', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3b6c6de4347c8539', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237681664', 'san:volume_id': '3b6c6de4347c85390521618411981c3cb4056caa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88812', 'name': 'v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] delete volume:v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] volume v_75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.quota [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Created reservations ['e44ba290-2423-4f42-9322-340e73c36d4f', '35309e0d-f566-4000-b4c2-a98f4bbd36ed', 'e84d69c7-1262-48b0-b12c-77bfb7f61fec', '25c22eeb-b995-41b3-956a-a333fbf432b2'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] create export for volume: cd931337-f058-4d2e-bb9b-21d50e96a28b. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] ensure volume cd931337-f058-4d2e-bb9b-21d50e96a28b assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] check if targe iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Geting {'code': 200, 'error': None, 'data': {'available': '114237775872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.manager [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Deleted volume successfully. Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e26d2e93-25e3-40ae-9e70-acdf446f4261 tempest-CreateVolumesFromSnapshotTest-870665439 None] Lock "cinder-75bc8bbb-6e3e-4ec1-ac62-8eeb74c7eadc-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] create target and attach volume cd931337-f058-4d2e-bb9b-21d50e96a28b to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] create target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Flow 'volume_create_manager' (a7bbf122-5a87-4052-ab34-87f3f674152f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7762c37a-c3b9-431f-b5b7-63ddb57eeb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7762c37a-c3b9-431f-b5b7-63ddb57eeb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1328112538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cedf2d1e-1887-4c93-963a-6b6f97fa9742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323dfbb938914fb58403a24a8e8cc77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:32:09Z,use_quota=True,user_id='85896f825efa44ca9ebd67d9baeb9252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f57c073-7795-4e99-9780-d935d57bd573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f57c073-7795-4e99-9780-d935d57bd573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c42515-1410-4dd5-b788-af9637116af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c42515-1410-4dd5-b788-af9637116af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'volume_name': 'volume-cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a948a70d-fbd2-48d3-b11b-064f4f354a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a948a70d-fbd2-48d3-b11b-064f4f354a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76595d5-1888-4d0e-871f-952bb4d2740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:09 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Volume cedf2d1e-1887-4c93-963a-6b6f97fa9742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'volume_size': 1} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] creating volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] create volume {'name': 'v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] atach volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b to target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'is_clone': False, 'name': 'v_cedf2d1e-1887-4c93-963a-6b6f97fa9742'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76595d5-1888-4d0e-871f-952bb4d2740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a62fa5-f4ea-45de-ad25-fb792c8bbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:10 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Volume volume-cedf2d1e-1887-4c93-963a-6b6f97fa9742 (cedf2d1e-1887-4c93-963a-6b6f97fa9742): created successfully Apr 14 04:32:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a62fa5-f4ea-45de-ad25-fb792c8bbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Flow 'volume_create_manager' (a7bbf122-5a87-4052-ab34-87f3f674152f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:32:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e9c5d7a9-79c5-4707-888a-ee91b5ddc1fb tempest-VolumeRevertTests-306508153 None] Created volume successfully. Apr 14 04:32:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] create snapshot ecf6f870-7413-4f8b-bcdd-ddb281842661 for volume cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:32:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] cloning v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 to s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:32:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] create snapshot s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:32:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3262646166356330', 'lun': 0, 'mode': 'wt', 'name': 'v_cd931337-f058-4d2e-bb9b-21d50e96a28b', 'prod_id': 'Storage', 'scsi_id': '2bdaf5c0d569c0de'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] add credentails to target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:32:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ecf6f870-7413-4f8b-bcdd-ddb281842661'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] create volume s_ecf6f870-7413-4f8b-bcdd-ddb281842661 from snapshot s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:32:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': {'name': 'KfcZYljW'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] initialize_connection for cd931337-f058-4d2e-bb9b-21d50e96a28b 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:32:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfcZYljW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0b5e165e-40ef-4330-a65d-5a6b0b96363f'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:32:13 user cinder-volume[73393]: INFO cinder.volume.manager [req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 req-e190f887-5924-4fa2-8e31-a2d38987e753 tempest-TestStampPattern-267011728 None] attachment_update completed successfully. Apr 14 04:32:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742@s_ecf6f870-7413-4f8b-bcdd-ddb281842661', 'is_clone': True, 'full_name': 'Pool-0/s_ecf6f870-7413-4f8b-bcdd-ddb281842661', 'name': 's_ecf6f870-7413-4f8b-bcdd-ddb281842661'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] volume s_ecf6f870-7413-4f8b-bcdd-ddb281842661 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:32:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1c032d24-c619-4b2f-a1f2-59cf4bd4efe2 tempest-VolumeRevertTests-306508153 None] Create snapshot completed successfully Apr 14 04:32:15 user cinder-volume[73393]: INFO cinder.volume.manager [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Start to perform revert to snapshot process. Apr 14 04:32:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] create snapshot 6e608b07-9017-4e8f-83cc-4b171eae7b4f for volume cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:32:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] cloning v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 to s_6e608b07-9017-4e8f-83cc-4b171eae7b4f {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:32:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] create snapshot s_6e608b07-9017-4e8f-83cc-4b171eae7b4f {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:32:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_6e608b07-9017-4e8f-83cc-4b171eae7b4f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] create volume s_6e608b07-9017-4e8f-83cc-4b171eae7b4f from snapshot s_6e608b07-9017-4e8f-83cc-4b171eae7b4f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:32:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742@s_6e608b07-9017-4e8f-83cc-4b171eae7b4f', 'is_clone': True, 'full_name': 'Pool-0/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f', 'name': 's_6e608b07-9017-4e8f-83cc-4b171eae7b4f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] volume s_6e608b07-9017-4e8f-83cc-4b171eae7b4f properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:32:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Create snapshot completed successfully Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] reverting v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 to s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) revert_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:420}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] get volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448139', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115845', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2370884061632413141', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8db032460b6ce1e6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237513728', 'san:volume_id': '8db032460b6ce1e656fdfb102a7bdad42a29bbfe', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89154', 'name': 'v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] rollback volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 to snapshot s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) rollback_volume_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:707}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/rollback {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/rollback {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] terminate connection for cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:32:18 user cinder-volume[73393]: INFO cinder.volume.manager [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Terminate volume connection completed successfully. Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Deleting attachment 0b5e165e-40ef-4330-a65d-5a6b0b96363f. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] remove_export for volume: cd931337-f058-4d2e-bb9b-21d50e96a28b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-292530258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cd931337-f058-4d2e-bb9b-21d50e96a28b,launched_at=2023-04-14T04:30:12Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0e6175a4372245a4a57dca1f12f7f007',provider_auth='CHAP KfcZYljW Ki2Z5ojLs13T8y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:10Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:32:18Z,use_quota=True,user_id='ebe3f41b95824cd78193d0bbe206a66b',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] detach volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b from target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': None} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/rollback {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] get volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] delete target: iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] delete target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448139', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115845', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2370884061632413141', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8db032460b6ce1e6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237546496', 'san:volume_id': '8db032460b6ce1e656fdfb102a7bdad42a29bbfe', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89154', 'name': 'v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Acquiring lock "cinder-6e608b07-9017-4e8f-83cc-4b171eae7b4f-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Lock "cinder-6e608b07-9017-4e8f-83cc-4b171eae7b4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] deleating snapshot s_6e608b07-9017-4e8f-83cc-4b171eae7b4f. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] get snapshots for volume s_6e608b07-9017-4e8f-83cc-4b171eae7b4f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f486042f-23ac-4de7-afce-a9f775a4ebe7 req-5d8c5cc7-1d50-40d4-af55-259138f77453 tempest-TestStampPattern-267011728 None] target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Geting {'code': 500, 'error': {'class': 'zfslib.zfsapi.resources.ZfsResourceError', 'errno': 1, 'message': 'Zfs resource: Pool-0/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f not found in this collection.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f/snapshots'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e608b07-9017-4e8f-83cc-4b171eae7b4f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] physical volume s_6e608b07-9017-4e8f-83cc-4b171eae7b4f dne, it was already deleted. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:655}} Apr 14 04:32:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Delete snapshot completed successfully. Apr 14 04:32:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Lock "cinder-6e608b07-9017-4e8f-83cc-4b171eae7b4f-delete_snapshot" released by "delete_snapshot" :: held 0.342s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-31ab62c3-dca8-4cad-8742-1b0e97977cf4 tempest-VolumeRevertTests-306508153 None] Volume cedf2d1e-1887-4c93-963a-6b6f97fa9742 reverted to snapshot ecf6f870-7413-4f8b-bcdd-ddb281842661 successfully. Apr 14 04:32:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Flow 'volume_create_manager' (63a92fe2-76ee-43c0-b2a6-be5ec92b4e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c59ee2-a572-4396-8c5a-b7fea674ee51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c59ee2-a572-4396-8c5a-b7fea674ee51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-883723823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2b40eb2c-e739-4fc0-bbdb-c8bc581689c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323dfbb938914fb58403a24a8e8cc77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:32:25Z,use_quota=True,user_id='85896f825efa44ca9ebd67d9baeb9252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f24fa2b-6cc9-47f9-a5a2-03a453de3002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f24fa2b-6cc9-47f9-a5a2-03a453de3002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f294b4f6-9441-41bb-8c3e-00a6beac66e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f294b4f6-9441-41bb-8c3e-00a6beac66e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'volume_name': 'volume-2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417b41d6-5f82-4376-8bef-8cee61dc732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417b41d6-5f82-4376-8bef-8cee61dc732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c35f897-24c4-4f11-a070-ca396c8fe8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:24 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Volume 2b40eb2c-e739-4fc0-bbdb-c8bc581689c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'volume_size': 1} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] creating volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] create volume {'name': 'v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114237546496', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'is_clone': False, 'name': 'v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c35f897-24c4-4f11-a070-ca396c8fe8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed653d29-8a36-44f9-afa0-15861a07345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:25 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Volume volume-2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 (2b40eb2c-e739-4fc0-bbdb-c8bc581689c3): created successfully Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed653d29-8a36-44f9-afa0-15861a07345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Flow 'volume_create_manager' (63a92fe2-76ee-43c0-b2a6-be5ec92b4e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:32:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-220091b5-8e56-4bdc-8947-293125f99a43 tempest-VolumeRevertTests-306508153 None] Created volume successfully. Apr 14 04:32:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] create snapshot 0cd33571-9448-4b5b-9d9e-0655eeac7b86 for volume 2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:32:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] cloning v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 to s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:32:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] create snapshot s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:32:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_0cd33571-9448-4b5b-9d9e-0655eeac7b86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] create volume s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 from snapshot s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:32:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3@s_0cd33571-9448-4b5b-9d9e-0655eeac7b86', 'is_clone': True, 'full_name': 'Pool-0/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86', 'name': 's_0cd33571-9448-4b5b-9d9e-0655eeac7b86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] volume s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:32:29 user cinder-volume[73393]: INFO cinder.volume.manager [None req-158bc0d3-c1ff-4834-a5f4-97b9be635e63 tempest-VolumeRevertTests-306508153 None] Create snapshot completed successfully Apr 14 04:32:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a806f844-229f-4de2-ae4e-57ad13fe2dd5 tempest-VolumeRevertTests-306508153 None] Extend volume 2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 04:32:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a806f844-229f-4de2-ae4e-57ad13fe2dd5 tempest-VolumeRevertTests-306508153 None] jdss extend volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 to 2147483648 {{(pid=73393) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 04:32:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a806f844-229f-4de2-ae4e-57ad13fe2dd5 tempest-VolumeRevertTests-306508153 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a806f844-229f-4de2-ae4e-57ad13fe2dd5 tempest-VolumeRevertTests-306508153 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a806f844-229f-4de2-ae4e-57ad13fe2dd5 tempest-VolumeRevertTests-306508153 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:30 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a806f844-229f-4de2-ae4e-57ad13fe2dd5 tempest-VolumeRevertTests-306508153 None] Extend volume completed successfully. Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Acquiring lock "cinder-0cd33571-9448-4b5b-9d9e-0655eeac7b86-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Lock "cinder-0cd33571-9448-4b5b-9d9e-0655eeac7b86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] deleating snapshot s_0cd33571-9448-4b5b-9d9e-0655eeac7b86. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] get snapshots for volume s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] get volume s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3@s_0cd33571-9448-4b5b-9d9e-0655eeac7b86', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448156', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115880', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15732557278038389149', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '42d436a10e1107ad', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237358080', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89716', 'name': 's_0cd33571-9448-4b5b-9d9e-0655eeac7b86', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] delete snapshot s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 of volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:32:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots/s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] snapshot s_0cd33571-9448-4b5b-9d9e-0655eeac7b86 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=27,cinder:SELECT=52,cinder:INSERT=2,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.quota [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Created reservations ['5a30ba5e-91d2-49a5-8839-ff2ca30a6307', '8f496eef-9815-4385-888a-960215d8b67b', '0d166bfa-72a8-4571-84c7-5c8d09c314e0', '54869320-db78-436b-a705-98bdd8694c6b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:34 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Delete snapshot completed successfully. Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f682034f-366b-496c-bebb-07d8a9ff477e tempest-VolumeRevertTests-306508153 None] Lock "cinder-0cd33571-9448-4b5b-9d9e-0655eeac7b86-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.coordination [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Acquiring lock "cinder-2b40eb2c-e739-4fc0-bbdb-c8bc581689c3-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.coordination [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Lock "cinder-2b40eb2c-e739-4fc0-bbdb-c8bc581689c3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] remove_export for volume: 2b40eb2c-e739-4fc0-bbdb-c8bc581689c3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-883723823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2b40eb2c-e739-4fc0-bbdb-c8bc581689c3,launched_at=2023-04-14T04:32:26Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='323dfbb938914fb58403a24a8e8cc77f',provider_auth='CHAP uMyPKkJl 0C8YwuobjkDSEt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:32:25Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:32:35Z,updated_at=2023-04-14T04:32:35Z,use_quota=True,user_id='85896f825efa44ca9ebd67d9baeb9252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] detach volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 from target iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/luns/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/luns/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/luns/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/luns/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] failed to remove resource iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 because of JDSS resource v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] delete target: iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] delete target iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] failed to remove resource iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 because of JDSS resource iqn.2010-10.org.openstack:2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] deleating volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] get snapshots for volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] get volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448154', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115874', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8366909603973686409', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '08b6250d8b03543c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237427712', 'san:volume_id': '08b6250d8b03543c1a12ecc77babec6f64d3938c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89539', 'name': 'v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] delete volume:v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] volume v_2b40eb2c-e739-4fc0-bbdb-c8bc581689c3 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.quota [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Created reservations ['b868f503-a40d-4c99-ac5f-e4c8361d0c1c', '2f016eb5-87be-4572-98da-42e09c367b4d', 'd0193835-7c14-4991-ac77-d6a0bb40735f', '2dfd0f02-70d0-4da4-90af-ff03097a34fb'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Acquiring lock "cinder-ecf6f870-7413-4f8b-bcdd-ddb281842661-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'available': '114237509632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.manager [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Deleted volume successfully. Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Lock "cinder-ecf6f870-7413-4f8b-bcdd-ddb281842661-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] deleating snapshot s_ecf6f870-7413-4f8b-bcdd-ddb281842661. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] get snapshots for volume s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-16797467-0130-4d02-af38-1b046f2b2bf3 tempest-VolumeRevertTests-306508153 None] Lock "cinder-2b40eb2c-e739-4fc0-bbdb-c8bc581689c3-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] get volume s_ecf6f870-7413-4f8b-bcdd-ddb281842661 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742@s_ecf6f870-7413-4f8b-bcdd-ddb281842661', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ecf6f870-7413-4f8b-bcdd-ddb281842661', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448142', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115855', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8831550510716527108', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'df66542f5462fcc8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237509632', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89168', 'name': 's_ecf6f870-7413-4f8b-bcdd-ddb281842661', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] delete snapshot s_ecf6f870-7413-4f8b-bcdd-ddb281842661 of volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots/s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots/s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots/s_ecf6f870-7413-4f8b-bcdd-ddb281842661 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] snapshot s_ecf6f870-7413-4f8b-bcdd-ddb281842661 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:32:40 user cinder-volume[73393]: DEBUG cinder.quota [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Created reservations ['90c6a224-c350-4e4c-99d3-d43a5c4051e0', '361c479e-8818-4677-a65f-fffb60b87b2c', '2496f75b-1768-408e-a1ea-c2b3b366b221', '06ee7c97-4521-4d1b-ad97-4ceccf9584c3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:40 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Delete snapshot completed successfully. Apr 14 04:32:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f4ab3ba6-dbf3-4004-9a76-c8cf92051c71 tempest-VolumeRevertTests-306508153 None] Lock "cinder-ecf6f870-7413-4f8b-bcdd-ddb281842661-delete_snapshot" released by "delete_snapshot" :: held 2.853s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Acquiring lock "cinder-2ea04249-09da-471f-a8b5-89a901381329-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Lock "cinder-2ea04249-09da-471f-a8b5-89a901381329-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Acquiring lock "cinder-cedf2d1e-1887-4c93-963a-6b6f97fa9742-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.coordination [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Lock "cinder-cedf2d1e-1887-4c93-963a-6b6f97fa9742-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] remove_export for volume: 2ea04249-09da-471f-a8b5-89a901381329. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1287411734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2ea04249-09da-471f-a8b5-89a901381329,launched_at=2023-04-14T04:25:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33320dc2f2c14ecfa5abf6574029c36c',provider_auth='CHAP dWfGZPuJ IkOp4ZAh9nad0g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:11Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:32:41Z,updated_at=2023-04-14T04:32:41Z,use_quota=True,user_id='5234914aec8e443b8a38ac6b38729031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] detach volume v_2ea04249-09da-471f-a8b5-89a901381329 from target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns/v_2ea04249-09da-471f-a8b5-89a901381329'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329/luns/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] failed to remove resource iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 because of JDSS resource v_2ea04249-09da-471f-a8b5-89a901381329 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] delete target: iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] delete target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] remove_export for volume: cedf2d1e-1887-4c93-963a-6b6f97fa9742. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1328112538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cedf2d1e-1887-4c93-963a-6b6f97fa9742,launched_at=2023-04-14T04:32:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323dfbb938914fb58403a24a8e8cc77f',provider_auth='CHAP urODbHpm xDcRL1fj3n5QuV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:32:09Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:32:41Z,updated_at=2023-04-14T04:32:41Z,use_quota=True,user_id='85896f825efa44ca9ebd67d9baeb9252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] detach volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 from target iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742/luns/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742/luns/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] failed to remove resource iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 because of JDSS resource iqn.2010-10.org.openstack:2ea04249-09da-471f-a8b5-89a901381329 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] deleating volume v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] get snapshots for volume v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742/luns/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742/luns/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] failed to remove resource iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 because of JDSS resource v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] delete target: iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] delete target iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] failed to remove resource iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 because of JDSS resource iqn.2010-10.org.openstack:cedf2d1e-1887-4c93-963a-6b6f97fa9742 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] deleating volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] get snapshots for volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] get volume v_2ea04249-09da-471f-a8b5-89a901381329 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2ea04249-09da-471f-a8b5-89a901381329', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447720', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115334', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17678177565055048221', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd8c6541ef2997d3b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237509632', 'san:volume_id': 'd8c6541ef2997d3bc87948e6fde2fb64fc1275fa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88536', 'name': 'v_2ea04249-09da-471f-a8b5-89a901381329', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] delete volume:v_2ea04249-09da-471f-a8b5-89a901381329 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] get volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448139', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115845', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2370884061632413141', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8db032460b6ce1e6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237509632', 'san:volume_id': '8db032460b6ce1e656fdfb102a7bdad42a29bbfe', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89154', 'name': 'v_cedf2d1e-1887-4c93-963a-6b6f97fa9742', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] delete volume:v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] terminate connection for e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:32:43 user cinder-volume[73393]: INFO cinder.volume.manager [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Terminate volume connection completed successfully. Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Deleting attachment 0f9216d9-463d-4546-b8b1-f30bf5bac3d6. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: e9e63107-a32f-4221-964d-9ee193d260fb. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e9e63107-a32f-4221-964d-9ee193d260fb,launched_at=2023-04-14T04:30:54Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP qBXmfngt aRp3EJOArbnuLP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:52Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=f5cc0b68-6502-4a55-96a0-69a8f27c433c,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:31:02Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_e9e63107-a32f-4221-964d-9ee193d260fb from target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] volume v_cedf2d1e-1887-4c93-963a-6b6f97fa9742 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2ea04249-09da-471f-a8b5-89a901381329 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] volume v_2ea04249-09da-471f-a8b5-89a901381329 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.quota [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Created reservations ['b430ca2f-6bb1-4bfb-b947-b4249dd87db3', '89418161-88e0-49b6-a81d-1670a2c3cf55', '7163c6cb-e744-479b-b840-8c16f04a8600', 'ba826790-55a1-4e96-ac8b-b9e5b65013ce'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.quota [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Created reservations ['b8aa4b53-82a1-4ccf-bc83-7056c5a66d3c', 'a7177467-13c1-4c93-9a07-363eb29264da', '47ce1a4e-05ee-473d-b54f-f953873ee528', '7c5f1821-dbaf-4407-a913-a9ce2c8ea890'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:43 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=55,cinder:INSERT=13,cinder:UPDATE=32 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:INSERT=7,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Geting {'code': 200, 'error': None, 'data': {'available': '114237509632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.manager [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:44 user cinder-volume[73393]: INFO cinder.volume.manager [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Deleted volume successfully. Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-88172677-6be8-4c33-9705-f5b9e650bf27 tempest-VolumeRevertTests-306508153 None] Lock "cinder-cedf2d1e-1887-4c93-963a-6b6f97fa9742-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Acquiring lock "cinder-e56b46c4-52ea-450b-8863-68ccb4ade295-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Lock "cinder-e56b46c4-52ea-450b-8863-68ccb4ade295-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] remove_export for volume: e56b46c4-52ea-450b-8863-68ccb4ade295. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1941384427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e56b46c4-52ea-450b-8863-68ccb4ade295,launched_at=2023-04-14T04:21:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33320dc2f2c14ecfa5abf6574029c36c',provider_auth='CHAP ZxaGmnDX jVaNl6PxAOmS1d',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:21:27Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:32:44Z,updated_at=2023-04-14T04:32:44Z,use_quota=True,user_id='5234914aec8e443b8a38ac6b38729031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] detach volume v_e56b46c4-52ea-450b-8863-68ccb4ade295 from target iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295/luns/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295/luns/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-6e21b4ea-72de-4b6f-896c-e4a684998c50 tempest-TestVolumeBootPattern-1780160917 None] target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295/luns/v_e56b46c4-52ea-450b-8863-68ccb4ade295'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295/luns/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] failed to remove resource iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 because of JDSS resource v_e56b46c4-52ea-450b-8863-68ccb4ade295 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] delete target: iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] delete target iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] failed to remove resource iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 because of JDSS resource iqn.2010-10.org.openstack:e56b46c4-52ea-450b-8863-68ccb4ade295 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] deleating volume v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] get snapshots for volume v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.coordination [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-e9e63107-a32f-4221-964d-9ee193d260fb-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.coordination [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-e9e63107-a32f-4221-964d-9ee193d260fb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: e9e63107-a32f-4221-964d-9ee193d260fb. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e9e63107-a32f-4221-964d-9ee193d260fb,launched_at=2023-04-14T04:30:54Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP qBXmfngt aRp3EJOArbnuLP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:52Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=f5cc0b68-6502-4a55-96a0-69a8f27c433c,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:32:45Z,updated_at=2023-04-14T04:32:45Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_e9e63107-a32f-4221-964d-9ee193d260fb from target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 200, 'error': None, 'data': {'available': '114237685760', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.manager [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:44 user cinder-volume[73393]: INFO cinder.volume.manager [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Deleted volume successfully. Apr 14 04:32:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-446e8093-980c-417b-9b06-2958b51ece79 tempest-ServerRescueNegativeTestJSON-508041341 None] Lock "cinder-2ea04249-09da-471f-a8b5-89a901381329-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] get volume v_e56b46c4-52ea-450b-8863-68ccb4ade295 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns/v_e9e63107-a32f-4221-964d-9ee193d260fb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb/luns/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb because of JDSS resource v_e9e63107-a32f-4221-964d-9ee193d260fb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e56b46c4-52ea-450b-8863-68ccb4ade295', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447496', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115036', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '293046000927881054', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '96641ffc33f803ab', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237685760', 'san:volume_id': '96641ffc33f803abf2d21c2735e64dafd2c71f98', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87875', 'name': 'v_e56b46c4-52ea-450b-8863-68ccb4ade295', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] delete volume:v_e56b46c4-52ea-450b-8863-68ccb4ade295 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb because of JDSS resource iqn.2010-10.org.openstack:e9e63107-a32f-4221-964d-9ee193d260fb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] deleating volume v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e56b46c4-52ea-450b-8863-68ccb4ade295 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] volume v_e56b46c4-52ea-450b-8863-68ccb4ade295 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.quota [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Created reservations ['235ebd1a-78a7-4cbf-9cbe-e0ebb3af2034', 'd7976180-6974-4953-9704-d188507c5deb', '528c2f9c-c20d-4fcd-b14d-393afd3ce8f6', '2eac813f-bbbf-4b52-a007-304758800932'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] get volume v_e9e63107-a32f-4221-964d-9ee193d260fb info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Geting {'code': 200, 'error': None, 'data': {'available': '114237767680', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.manager [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:48 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Deleted volume successfully. Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b42ca92e-47e0-4288-8c87-0cecf6215235 tempest-ServerRescueNegativeTestJSON-508041341 None] Lock "cinder-e56b46c4-52ea-450b-8863-68ccb4ade295-delete_volume" released by "delete_volume" :: held 4.271s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c@v_e9e63107-a32f-4221-964d-9ee193d260fb', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e9e63107-a32f-4221-964d-9ee193d260fb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448062', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26120192', 'sharesmb': None, 'createtxg': '115763', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11439285061680656892', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '274432', 'logicalused': '1228800', 'compressratio': '5.45', 'rootcontext': 'none', 'default_scsi_id': '815a8c70a86d7512', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237767680', 'san:volume_id': '815a8c70a86d7512d8d61628595bc2b592c70e31', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '274432', 'objsetid': '88426', 'name': 'v_e9e63107-a32f-4221-964d-9ee193d260fb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '274432', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] delete snapshot v_e9e63107-a32f-4221-964d-9ee193d260fb of volume s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Flow 'volume_create_manager' (0a2f21e9-9f7b-4cc5-87c1-c0a01def8997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0523fa7b-4398-46f7-bafb-0bda145a007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0523fa7b-4398-46f7-bafb-0bda145a007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:32:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9108333c-dbbf-4edb-a2b5-c6f034073970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5995b934b0546c0983387e46e3b3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:32:50Z,use_quota=True,user_id='6ec7103e06e643a6b9b2c908ba8d7b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36b77cc-f3a5-441a-bf8a-2c437b6b0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36b77cc-f3a5-441a-bf8a-2c437b6b0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a471fe0-f7b0-4ab1-a776-b7ebb172f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots/v_e9e63107-a32f-4221-964d-9ee193d260fb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] snapshot v_e9e63107-a32f-4221-964d-9ee193d260fb deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a471fe0-f7b0-4ab1-a776-b7ebb172f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9108333c-dbbf-4edb-a2b5-c6f034073970', 'volume_name': 'volume-9108333c-dbbf-4edb-a2b5-c6f034073970', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f593f93-f4e0-4fa6-9e5c-6a115d81f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f593f93-f4e0-4fa6-9e5c-6a115d81f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cea5bc-8a9a-4154-b0d8-9bbd4e473e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:50 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Volume 9108333c-dbbf-4edb-a2b5-c6f034073970: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9108333c-dbbf-4edb-a2b5-c6f034073970', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Cloning 9108333c-dbbf-4edb-a2b5-c6f034073970 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.coordination [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.coordination [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.image.cache [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 32, 50, 508280)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.image.cache [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.coordination [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.image.cache [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 32, 50, 525513)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.image.cache [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create snapshot v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.quota [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['1f335fec-7c7b-4f8b-bed0-1609a61390bc', 'b551ecda-64c4-415d-a87f-e3a3b7818c8f', 'e31b7158-7f39-4129-9d33-a1c174277953', '3cb6fbaa-32f4-448b-89eb-62059d72f3f4'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_9108333c-dbbf-4edb-a2b5-c6f034073970'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create volume v_9108333c-dbbf-4edb-a2b5-c6f034073970 from snapshot v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:32:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238115840', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:32:52 user cinder-volume[73393]: DEBUG cinder.manager [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:32:52 user cinder-volume[73393]: INFO cinder.volume.manager [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Deleted volume successfully. Apr 14 04:32:52 user cinder-volume[73393]: DEBUG cinder.coordination [req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 req-acd17d43-c413-45e9-83fe-bf328facb7d2 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-e9e63107-a32f-4221-964d-9ee193d260fb-delete_volume" released by "delete_volume" :: held 7.721s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_9108333c-dbbf-4edb-a2b5-c6f034073970', 'is_clone': True, 'full_name': 'Pool-0/v_9108333c-dbbf-4edb-a2b5-c6f034073970', 'name': 'v_9108333c-dbbf-4edb-a2b5-c6f034073970'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] get volume v_9108333c-dbbf-4edb-a2b5-c6f034073970 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_9108333c-dbbf-4edb-a2b5-c6f034073970', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9108333c-dbbf-4edb-a2b5-c6f034073970', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448181', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115908', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13528876662371864053', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c418066358a6641a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238103552', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88313', 'name': 'v_9108333c-dbbf-4edb-a2b5-c6f034073970', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Marking volume 9108333c-dbbf-4edb-a2b5-c6f034073970 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 9108333c-dbbf-4edb-a2b5-c6f034073970. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Creating volume glance metadata for volume 9108333c-dbbf-4edb-a2b5-c6f034073970 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cea5bc-8a9a-4154-b0d8-9bbd4e473e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9108333c-dbbf-4edb-a2b5-c6f034073970', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb883110-3561-4015-92b4-b5efa24a6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:32:53 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Volume volume-9108333c-dbbf-4edb-a2b5-c6f034073970 (9108333c-dbbf-4edb-a2b5-c6f034073970): created successfully Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb883110-3561-4015-92b4-b5efa24a6154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:32:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Flow 'volume_create_manager' (0a2f21e9-9f7b-4cc5-87c1-c0a01def8997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:32:53 user cinder-volume[73393]: INFO cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-a1b9c307-8532-4bc4-a9cf-fffbd5e88fd2 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Created volume successfully. Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create export for volume: 9108333c-dbbf-4edb-a2b5-c6f034073970. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] ensure volume 9108333c-dbbf-4edb-a2b5-c6f034073970 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] check if targe iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create target and attach volume 9108333c-dbbf-4edb-a2b5-c6f034073970 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] create target iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:32:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:32:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] atach volume v_9108333c-dbbf-4edb-a2b5-c6f034073970 to target iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:32:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:32:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6334313830363633', 'lun': 0, 'mode': 'wt', 'name': 'v_9108333c-dbbf-4edb-a2b5-c6f034073970', 'prod_id': 'Storage', 'scsi_id': 'c418066358a6641a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] add credentails to target iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:33:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 201, 'error': None, 'data': {'name': 'deafxyMo'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] initialize_connection for 9108333c-dbbf-4edb-a2b5-c6f034073970 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:33:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deafxyMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5ae6bc76-75a1-4f44-99a1-fdb9bf96b0ef'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:33:00 user cinder-volume[73393]: INFO cinder.volume.manager [req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf req-d0772ec7-96ab-4000-8b3b-e59181c7929b tempest-ServerBootFromVolumeStableRescueTest-247821842 None] attachment_update completed successfully. Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Flow 'volume_create_manager' (b4b8bc5d-eaab-44d6-8fb9-8830d413fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9481dbe5-8e33-4c42-86ff-74af83af3f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9481dbe5-8e33-4c42-86ff-74af83af3f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1153378244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=992a3f86-d313-4b1e-9491-3008be037269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:33:01Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af63f59-5583-45c6-acb3-af8176e095aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af63f59-5583-45c6-acb3-af8176e095aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27455290-ffdf-4ee7-a905-e2d7d4872a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27455290-ffdf-4ee7-a905-e2d7d4872a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '992a3f86-d313-4b1e-9491-3008be037269', 'volume_name': 'volume-992a3f86-d313-4b1e-9491-3008be037269', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748f5919-e1c1-4aa6-a435-e2450a2665ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748f5919-e1c1-4aa6-a435-e2450a2665ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184ca422-c472-405c-900f-094dd7cbf0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:01 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Volume 992a3f86-d313-4b1e-9491-3008be037269: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-992a3f86-d313-4b1e-9491-3008be037269', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Cloning 992a3f86-d313-4b1e-9491-3008be037269 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 33, 1, 567327)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 33, 1, 582427)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] create snapshot v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_992a3f86-d313-4b1e-9491-3008be037269'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] create volume v_992a3f86-d313-4b1e-9491-3008be037269 from snapshot v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:33:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_992a3f86-d313-4b1e-9491-3008be037269', 'is_clone': True, 'full_name': 'Pool-0/v_992a3f86-d313-4b1e-9491-3008be037269', 'name': 'v_992a3f86-d313-4b1e-9491-3008be037269'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] get volume v_992a3f86-d313-4b1e-9491-3008be037269 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_992a3f86-d313-4b1e-9491-3008be037269', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_992a3f86-d313-4b1e-9491-3008be037269', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448191', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115919', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7563655901441508740', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e1c3d039cc119196', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238091264', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89738', 'name': 'v_992a3f86-d313-4b1e-9491-3008be037269', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Marking volume 992a3f86-d313-4b1e-9491-3008be037269 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=27,cinder:SELECT=64,cinder:INSERT=9 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Creating volume glance metadata for volume 992a3f86-d313-4b1e-9491-3008be037269 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:DELETE=5,cinder:UPDATE=26,cinder:INSERT=11 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184ca422-c472-405c-900f-094dd7cbf0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992a3f86-d313-4b1e-9491-3008be037269', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c919de59-533f-4719-8dd8-fb0e4a6c641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:04 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Volume volume-992a3f86-d313-4b1e-9491-3008be037269 (992a3f86-d313-4b1e-9491-3008be037269): created successfully Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c919de59-533f-4719-8dd8-fb0e4a6c641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Flow 'volume_create_manager' (b4b8bc5d-eaab-44d6-8fb9-8830d413fcee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:33:04 user cinder-volume[73393]: INFO cinder.volume.manager [None req-36bb93a9-77cb-49b8-8188-2c1d2021e5e1 tempest-ServerActionsTestJSON-1048786641 None] Created volume successfully. Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] create export for volume: 992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] ensure volume 992a3f86-d313-4b1e-9491-3008be037269 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] check if targe iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] create target and attach volume 992a3f86-d313-4b1e-9491-3008be037269 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] create target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] create snapshot 63106e01-f69c-423b-87a5-a3c6b2f0ea0e for volume cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:33:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] cloning v_cd931337-f058-4d2e-bb9b-21d50e96a28b to s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:33:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] create snapshot s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:33:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_63106e01-f69c-423b-87a5-a3c6b2f0ea0e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] create volume s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e from snapshot s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] atach volume v_992a3f86-d313-4b1e-9491-3008be037269 to target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_cd931337-f058-4d2e-bb9b-21d50e96a28b@s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e', 'is_clone': True, 'full_name': 'Pool-0/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e', 'name': 's_63106e01-f69c-423b-87a5-a3c6b2f0ea0e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] volume s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:33:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b2713e9c-73c0-4241-8ac4-00dad3bda0ee tempest-TestStampPattern-267011728 None] Create snapshot completed successfully Apr 14 04:33:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6531633364303339', 'lun': 0, 'mode': 'wt', 'name': 'v_992a3f86-d313-4b1e-9491-3008be037269', 'prod_id': 'Storage', 'scsi_id': 'e1c3d039cc119196'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] add credentails to target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:33:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'name': 'sPgLhMjz'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] initialize_connection for 992a3f86-d313-4b1e-9491-3008be037269 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:33:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPgLhMjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'bd68b9f6-ee70-4c4e-b98b-a28568ab823f'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:33:11 user cinder-volume[73393]: INFO cinder.volume.manager [req-62db2ca5-1eb7-4991-810b-64f604e00e3e req-1a640a05-3b76-424d-a743-a2c0e4bdbdad tempest-ServerActionsTestJSON-1048786641 None] attachment_update completed successfully. Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Flow 'volume_create_manager' (fb96d425-5588-4d32-8042-4765959dc2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e7647f-477f-43fb-8928-37c261b632bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e7647f-477f-43fb-8928-37c261b632bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910134736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a61cb439-0424-4fe3-8c33-2b14401ebcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6175a4372245a4a57dca1f12f7f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63106e01-f69c-423b-87a5-a3c6b2f0ea0e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:33:19Z,use_quota=True,user_id='ebe3f41b95824cd78193d0bbe206a66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc791c29-e3af-489f-98d5-86e61b697c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc791c29-e3af-489f-98d5-86e61b697c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1e5193-e669-4d66-a0c4-5e584a673d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1e5193-e669-4d66-a0c4-5e584a673d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'volume_name': 'volume-a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'volume_size': 1, 'snapshot_id': '63106e01-f69c-423b-87a5-a3c6b2f0ea0e'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faac052-b4b8-4051-a26e-f10fa6c29682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faac052-b4b8-4051-a26e-f10fa6c29682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c23af1-6add-41ad-82df-b14e1a239a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:18 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Volume a61cb439-0424-4fe3-8c33-2b14401ebcc7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'volume_size': 1, 'snapshot_id': '63106e01-f69c-423b-87a5-a3c6b2f0ea0e'} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] create volume a61cb439-0424-4fe3-8c33-2b14401ebcc7 from snapshot 63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] cloning s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e to v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] create snapshot v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_a61cb439-0424-4fe3-8c33-2b14401ebcc7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] create volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 from snapshot v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:33:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e@v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'is_clone': True, 'full_name': 'Pool-0/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'name': 'v_a61cb439-0424-4fe3-8c33-2b14401ebcc7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] get volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e@v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448209', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '115937', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5343743918437604206', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1da89abf66e44cb2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227900416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89777', 'name': 'v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c23af1-6add-41ad-82df-b14e1a239a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'volume_size': 1, 'snapshot_id': '63106e01-f69c-423b-87a5-a3c6b2f0ea0e'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c78dd8d-caf5-4a7f-a356-ec05d5b7bb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:33:21 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Volume volume-a61cb439-0424-4fe3-8c33-2b14401ebcc7 (a61cb439-0424-4fe3-8c33-2b14401ebcc7): created successfully Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c78dd8d-caf5-4a7f-a356-ec05d5b7bb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:33:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Flow 'volume_create_manager' (fb96d425-5588-4d32-8042-4765959dc2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:33:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-635c018f-8df8-4252-8e27-ac4ee643c511 tempest-TestStampPattern-267011728 None] Created volume successfully. Apr 14 04:33:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:33:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:33:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:33:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114227888128', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:33:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-f5cc0b68-6502-4a55-96a0-69a8f27c433c-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-f5cc0b68-6502-4a55-96a0-69a8f27c433c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] deleating snapshot s_f5cc0b68-6502-4a55-96a0-69a8f27c433c. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] get volume s_f5cc0b68-6502-4a55-96a0-69a8f27c433c info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_300999d2-cadf-4299-8a05-85dec6b7d895@s_f5cc0b68-6502-4a55-96a0-69a8f27c433c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448056', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26112000', 'sharesmb': None, 'createtxg': '115755', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1019401077477799685', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3111235f3f744484', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227765248', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '89522', 'name': 's_f5cc0b68-6502-4a55-96a0-69a8f27c433c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] delete snapshot s_f5cc0b68-6502-4a55-96a0-69a8f27c433c of volume v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:33:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots/s_f5cc0b68-6502-4a55-96a0-69a8f27c433c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] snapshot s_f5cc0b68-6502-4a55-96a0-69a8f27c433c deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:33:34 user cinder-volume[73393]: DEBUG cinder.quota [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['fced2f1c-35fa-46c0-a84e-711d237edd83', '69e1a480-e13f-44a2-bc6f-1f6352f0e8d9', '3f91f8d6-1932-48f8-8abf-65ba2f696a25', 'd8de46c8-77d9-4735-a554-1e8dac542538'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:33:34 user cinder-volume[73393]: INFO cinder.volume.manager [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Delete snapshot completed successfully. Apr 14 04:33:34 user cinder-volume[73393]: DEBUG cinder.coordination [None req-30993008-2e58-4922-80a0-4a3c9319d54a tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-f5cc0b68-6502-4a55-96a0-69a8f27c433c-delete_snapshot" released by "delete_snapshot" :: held 2.848s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=51,cinder:INSERT=14,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=38,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] terminate connection for 300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:33:36 user cinder-volume[73393]: INFO cinder.volume.manager [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Terminate volume connection completed successfully. Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Deleting attachment 380712c0-d593-4894-9e7c-53a4bc13bbe7. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 300999d2-cadf-4299-8a05-85dec6b7d895. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1148171054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=300999d2-cadf-4299-8a05-85dec6b7d895,launched_at=2023-04-14T04:28:53Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP myaLbCEo oqWJZ6KTOvb38Q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:51Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:29:01Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_300999d2-cadf-4299-8a05-85dec6b7d895 from target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-6490bf22-fb96-4778-8c68-b8f80bbe2ce5 tempest-TestVolumeBootPattern-1780160917 None] target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.coordination [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-300999d2-cadf-4299-8a05-85dec6b7d895-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.coordination [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-300999d2-cadf-4299-8a05-85dec6b7d895-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 300999d2-cadf-4299-8a05-85dec6b7d895. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1148171054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=300999d2-cadf-4299-8a05-85dec6b7d895,launched_at=2023-04-14T04:28:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP myaLbCEo oqWJZ6KTOvb38Q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:28:51Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:33:38Z,updated_at=2023-04-14T04:33:38Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_300999d2-cadf-4299-8a05-85dec6b7d895 from target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns/v_300999d2-cadf-4299-8a05-85dec6b7d895'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895/luns/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 because of JDSS resource v_300999d2-cadf-4299-8a05-85dec6b7d895 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 because of JDSS resource iqn.2010-10.org.openstack:300999d2-cadf-4299-8a05-85dec6b7d895 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] deleating volume v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] get volume v_300999d2-cadf-4299-8a05-85dec6b7d895 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_300999d2-cadf-4299-8a05-85dec6b7d895', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_300999d2-cadf-4299-8a05-85dec6b7d895', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447941', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26112000', 'sharesmb': None, 'createtxg': '115620', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2500258779471554768', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10133504', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': '91e4550fdbd1076d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217807872', 'san:volume_id': '91e4550fdbd1076d56bc5c0279475e39bf185542', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10133504', 'objsetid': '88411', 'name': 'v_300999d2-cadf-4299-8a05-85dec6b7d895', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10133504', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] delete snapshot v_300999d2-cadf-4299-8a05-85dec6b7d895 of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_300999d2-cadf-4299-8a05-85dec6b7d895 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] snapshot v_300999d2-cadf-4299-8a05-85dec6b7d895 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.quota [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['63bd9b2b-8001-41cd-8800-c0981a3a8a68', '38f0c31f-fb48-4e07-84c9-8a38b0b660b4', '04b05f40-485e-4498-9c8d-59bd5131b20b', 'f60b6227-e72c-4630-9e4f-760f43753a10'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227990528', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.manager [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:33:40 user cinder-volume[73393]: INFO cinder.volume.manager [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Deleted volume successfully. Apr 14 04:33:40 user cinder-volume[73393]: DEBUG cinder.coordination [req-885a1967-e3a5-4703-b8d4-3086631b0d12 req-23b91aa5-9bb6-4236-b918-07cc827da7a0 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-300999d2-cadf-4299-8a05-85dec6b7d895-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:34:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=16,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:34:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:34:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:34:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114227982336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:34:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:34:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:27 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (0b10f6ed-5d97-4cb0-9210-b03ae6020b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e943cccb-70e6-4803-ae25-487ba3c2e60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e943cccb-70e6-4803-ae25-487ba3c2e60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-754464795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=495f173c-6873-42b6-a0fe-42da67f3aa75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:34:28Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79784754-f62c-435a-ab2e-c7f8b72e48aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79784754-f62c-435a-ab2e-c7f8b72e48aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aac09b0-439c-4729-b1d1-de94e8957b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aac09b0-439c-4729-b1d1-de94e8957b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '495f173c-6873-42b6-a0fe-42da67f3aa75', 'volume_name': 'volume-495f173c-6873-42b6-a0fe-42da67f3aa75', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48179ca-adfe-40d6-aee9-5387284f2fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48179ca-adfe-40d6-aee9-5387284f2fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cb5232-8481-4b99-bced-a4043945039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:34:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Volume 495f173c-6873-42b6-a0fe-42da67f3aa75: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-495f173c-6873-42b6-a0fe-42da67f3aa75', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Cloning 495f173c-6873-42b6-a0fe-42da67f3aa75 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 34, 28, 460300)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 34, 28, 474158)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] create snapshot v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_495f173c-6873-42b6-a0fe-42da67f3aa75'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] create volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 from snapshot v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:34:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'is_clone': True, 'full_name': 'Pool-0/v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'name': 'v_495f173c-6873-42b6-a0fe-42da67f3aa75'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] get volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448278', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '115964', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5680990764993550689', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '12d4bb3c395f8b29', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227957760', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89042', 'name': 'v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Marking volume 495f173c-6873-42b6-a0fe-42da67f3aa75 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Creating volume glance metadata for volume 495f173c-6873-42b6-a0fe-42da67f3aa75 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cb5232-8481-4b99-bced-a4043945039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495f173c-6873-42b6-a0fe-42da67f3aa75', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beba2d9-1a43-49aa-98c1-f2d303eb6164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:34:30 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Volume volume-495f173c-6873-42b6-a0fe-42da67f3aa75 (495f173c-6873-42b6-a0fe-42da67f3aa75): created successfully Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beba2d9-1a43-49aa-98c1-f2d303eb6164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:34:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (0b10f6ed-5d97-4cb0-9210-b03ae6020b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:34:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-612c6b68-ec3b-4a9c-8325-a96b85ea5504 tempest-TestVolumeBootPattern-1780160917 None] Created volume successfully. Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] create export for volume: 495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] ensure volume 495f173c-6873-42b6-a0fe-42da67f3aa75 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] check if targe iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] create target and attach volume 495f173c-6873-42b6-a0fe-42da67f3aa75 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] create target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] atach volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 to target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:34:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3132643462623363', 'lun': 0, 'mode': 'wt', 'name': 'v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'prod_id': 'Storage', 'scsi_id': '12d4bb3c395f8b29'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] add credentails to target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:34:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:34:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:34:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tLxSpwaP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:34:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] initialize_connection for 495f173c-6873-42b6-a0fe-42da67f3aa75 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:34:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLxSpwaP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '747d47a5-c9e1-4781-a1f4-f44c95772ca8'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:34:39 user cinder-volume[73393]: INFO cinder.volume.manager [req-070d1eeb-8692-4250-8cdd-485a0eca3d17 req-236d5afb-9e15-46d6-8ece-3a6f566dec71 tempest-TestVolumeBootPattern-1780160917 None] attachment_update completed successfully. Apr 14 04:34:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=34,cinder:UPDATE=3,cinder:INSERT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=29,cinder:UPDATE=11,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] terminate connection for 992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:35:02 user cinder-volume[73393]: INFO cinder.volume.manager [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Terminate volume connection completed successfully. Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Deleting attachment bd68b9f6-ee70-4c4e-b98b-a28568ab823f. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1153378244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=992a3f86-d313-4b1e-9491-3008be037269,launched_at=2023-04-14T04:33:04Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP sPgLhMjz UdoNt3CFcEDRpl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:33:01Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:33:12Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] detach volume v_992a3f86-d313-4b1e-9491-3008be037269 from target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31933166-993d-4df1-ac8a-075e136e0307 req-c3c74e5c-078b-404b-b79e-d1ab1aaed572 tempest-ServerActionsTestJSON-1048786641 None] target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] create export for volume: 992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] ensure volume 992a3f86-d313-4b1e-9491-3008be037269 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] check if targe iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] create target and attach volume 992a3f86-d313-4b1e-9491-3008be037269 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] create target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] atach volume v_992a3f86-d313-4b1e-9491-3008be037269 to target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:35:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6531633364303339', 'lun': 0, 'mode': 'wt', 'name': 'v_992a3f86-d313-4b1e-9491-3008be037269', 'prod_id': 'Storage', 'scsi_id': 'e1c3d039cc119196'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] add credentails to target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:35:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 201, 'error': None, 'data': {'name': 'sPgLhMjz'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] initialize_connection for 992a3f86-d313-4b1e-9491-3008be037269 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:35:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPgLhMjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '330200a1-d9ad-42ed-be96-0bc76ac890b7'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:35:08 user cinder-volume[73393]: INFO cinder.volume.manager [req-31933166-993d-4df1-ac8a-075e136e0307 req-55d96677-21af-4553-b0e5-35199cf7399e tempest-ServerActionsTestJSON-1048786641 None] attachment_update completed successfully. Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] create export for volume: a61cb439-0424-4fe3-8c33-2b14401ebcc7. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] ensure volume a61cb439-0424-4fe3-8c33-2b14401ebcc7 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] check if targe iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] create target and attach volume a61cb439-0424-4fe3-8c33-2b14401ebcc7 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] create target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] atach volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 to target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:35:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3164613839616266', 'lun': 0, 'mode': 'wt', 'name': 'v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'prod_id': 'Storage', 'scsi_id': '1da89abf66e44cb2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] add credentails to target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:35:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Geting {'code': 201, 'error': None, 'data': {'name': 'DFodRXjk'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] initialize_connection for a61cb439-0424-4fe3-8c33-2b14401ebcc7 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:35:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFodRXjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'cea7ff72-8604-43c9-9b3e-27aea6d0a56b'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:35:20 user cinder-volume[73393]: INFO cinder.volume.manager [req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 req-84548864-250c-4fea-b2df-51d751245553 tempest-TestStampPattern-267011728 None] attachment_update completed successfully. Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] terminate connection for a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:35:24 user cinder-volume[73393]: INFO cinder.volume.manager [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Terminate volume connection completed successfully. Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Deleting attachment cea7ff72-8604-43c9-9b3e-27aea6d0a56b. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] remove_export for volume: a61cb439-0424-4fe3-8c33-2b14401ebcc7. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910134736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a61cb439-0424-4fe3-8c33-2b14401ebcc7,launched_at=2023-04-14T04:33:21Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0e6175a4372245a4a57dca1f12f7f007',provider_auth='CHAP DFodRXjk VewEdG5obHT8W6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:33:19Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=63106e01-f69c-423b-87a5-a3c6b2f0ea0e,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:35:23Z,use_quota=True,user_id='ebe3f41b95824cd78193d0bbe206a66b',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] detach volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 from target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] delete target: iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] delete target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:35:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:35:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-224bc18a-8e01-444e-a640-74b0cee1e957 req-4d12d473-6cce-4f04-92ca-669ddb38d74c tempest-TestStampPattern-267011728 None] target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:35:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114217639936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:35:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:35:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:35:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=29,cinder:UPDATE=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=36,cinder:UPDATE=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:17 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:36:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:36:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:36:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114217623552', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:36:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] terminate connection for 495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:36:28 user cinder-volume[73393]: INFO cinder.volume.manager [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Terminate volume connection completed successfully. Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Deleting attachment 747d47a5-c9e1-4781-a1f4-f44c95772ca8. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-754464795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=495f173c-6873-42b6-a0fe-42da67f3aa75,launched_at=2023-04-14T04:34:31Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP tLxSpwaP hEYenvUbs4uCaf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:34:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:34:39Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 from target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 req-a15ff03c-51e3-4441-875d-63c985305e37 tempest-TestVolumeBootPattern-1780160917 None] target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Flow 'volume_create_manager' (11e1e5e1-6d40-47e4-974c-17fbb42c2b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95cbe81-c711-44a1-a05b-b13c9e4b5c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95cbe81-c711-44a1-a05b-b13c9e4b5c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2063819679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5615b9ab-7102-4d44-a55e-0e2581c39757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:36:36Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a2fba1-4a74-48a6-ad5f-2cf60f686e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a2fba1-4a74-48a6-ad5f-2cf60f686e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a94f0b3-6e4a-44b4-a13e-a4915b50fdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a94f0b3-6e4a-44b4-a13e-a4915b50fdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5615b9ab-7102-4d44-a55e-0e2581c39757', 'volume_name': 'volume-5615b9ab-7102-4d44-a55e-0e2581c39757', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8ab02f-c8a2-46ec-97a5-b4aad937f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8ab02f-c8a2-46ec-97a5-b4aad937f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2868c07-33dd-4642-85ec-ae2e762c2e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:36:36 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Volume 5615b9ab-7102-4d44-a55e-0e2581c39757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5615b9ab-7102-4d44-a55e-0e2581c39757', 'volume_size': 1} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] creating volume v_5615b9ab-7102-4d44-a55e-0e2581c39757. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] create volume {'name': 'v_5615b9ab-7102-4d44-a55e-0e2581c39757', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5615b9ab-7102-4d44-a55e-0e2581c39757', 'is_clone': False, 'name': 'v_5615b9ab-7102-4d44-a55e-0e2581c39757'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2868c07-33dd-4642-85ec-ae2e762c2e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5615b9ab-7102-4d44-a55e-0e2581c39757', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:36:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ade674-3e7e-4670-b3a3-0f8b75d7838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:36:37 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Volume volume-5615b9ab-7102-4d44-a55e-0e2581c39757 (5615b9ab-7102-4d44-a55e-0e2581c39757): created successfully Apr 14 04:36:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ade674-3e7e-4670-b3a3-0f8b75d7838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:36:37 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Flow 'volume_create_manager' (11e1e5e1-6d40-47e4-974c-17fbb42c2b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:36:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-767655cd-ab50-4c88-8800-e61abe62fdf7 tempest-AttachVolumeNegativeTest-1197484356 None] Created volume successfully. Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] create export for volume: 5615b9ab-7102-4d44-a55e-0e2581c39757. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] ensure volume 5615b9ab-7102-4d44-a55e-0e2581c39757 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] check if targe iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] create target and attach volume 5615b9ab-7102-4d44-a55e-0e2581c39757 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] create target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] atach volume v_5615b9ab-7102-4d44-a55e-0e2581c39757 to target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:36:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3133613436386163', 'lun': 0, 'mode': 'wt', 'name': 'v_5615b9ab-7102-4d44-a55e-0e2581c39757', 'prod_id': 'Storage', 'scsi_id': '13a468ac533f34f9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] add credentails to target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:36:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:36:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:36:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TgIjxlbS'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:36:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] initialize_connection for 5615b9ab-7102-4d44-a55e-0e2581c39757 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:36:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgIjxlbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9fdd36f5-c84d-4582-a392-992dcb0830ca'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:36:43 user cinder-volume[73393]: INFO cinder.volume.manager [req-2b8f4352-72ba-4870-8527-26f4acecd97c req-aa01b7cb-aa7e-4a56-a67d-42d5d8fed387 tempest-AttachVolumeNegativeTest-1197484356 None] attachment_update completed successfully. Apr 14 04:36:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=23,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=24,cinder:UPDATE=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Acquiring lock "cinder-a61cb439-0424-4fe3-8c33-2b14401ebcc7-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Lock "cinder-a61cb439-0424-4fe3-8c33-2b14401ebcc7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] remove_export for volume: a61cb439-0424-4fe3-8c33-2b14401ebcc7. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910134736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a61cb439-0424-4fe3-8c33-2b14401ebcc7,launched_at=2023-04-14T04:33:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6175a4372245a4a57dca1f12f7f007',provider_auth='CHAP DFodRXjk VewEdG5obHT8W6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:33:19Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=63106e01-f69c-423b-87a5-a3c6b2f0ea0e,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:37:05Z,updated_at=2023-04-14T04:37:05Z,use_quota=True,user_id='ebe3f41b95824cd78193d0bbe206a66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] detach volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 from target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7/luns/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] failed to remove resource iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 because of JDSS resource v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] delete target: iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] delete target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] failed to remove resource iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 because of JDSS resource iqn.2010-10.org.openstack:a61cb439-0424-4fe3-8c33-2b14401ebcc7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] deleating volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] get snapshots for volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] get volume v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e@v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448209', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '115937', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5343743918437604206', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '90112', 'logicalused': '303104', 'compressratio': '6.16', 'rootcontext': 'none', 'default_scsi_id': '1da89abf66e44cb2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217500672', 'san:volume_id': '1da89abf66e44cb2f5a0003a71b73b4ccc11f483', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '90112', 'objsetid': '89777', 'name': 'v_a61cb439-0424-4fe3-8c33-2b14401ebcc7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '90112', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] delete snapshot v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 of volume s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots/v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] snapshot v_a61cb439-0424-4fe3-8c33-2b14401ebcc7 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.quota [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Created reservations ['c103ab90-ce4a-44fb-bca0-2d4fabae955d', 'c5ab4406-bd35-497a-818c-6894ab0acfaa', '9100c6d2-5e6d-4323-ba07-dbe23b4e126b', 'e0011860-d3b1-4a51-b7de-76505e04b3ff'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'available': '114217639936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.manager [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:37:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Deleted volume successfully. Apr 14 04:37:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0beb9c23-7450-4688-bfd9-d047dbdcd356 tempest-TestStampPattern-267011728 None] Lock "cinder-a61cb439-0424-4fe3-8c33-2b14401ebcc7-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.coordination [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Acquiring lock "cinder-63106e01-f69c-423b-87a5-a3c6b2f0ea0e-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.coordination [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Lock "cinder-63106e01-f69c-423b-87a5-a3c6b2f0ea0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] deleating snapshot s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] get snapshots for volume s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] get volume s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_cd931337-f058-4d2e-bb9b-21d50e96a28b@s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448198', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '115925', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '822229838605119002', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '026fd7b63475efca', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217639936', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '89753', 'name': 's_63106e01-f69c-423b-87a5-a3c6b2f0ea0e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] delete snapshot s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e of volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:37:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots/s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] snapshot s_63106e01-f69c-423b-87a5-a3c6b2f0ea0e deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:37:10 user cinder-volume[73393]: DEBUG cinder.quota [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Created reservations ['8aa3dfbe-51b2-45e7-861f-18eb432a2fe3', '959ddf7b-3dfb-46bd-81b9-4fa4e4f615c4', '0070a45d-aa6f-4c49-9608-90f2586b1197', '1152c1ac-15fd-4e49-a655-42d1e54650b4'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:37:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Delete snapshot completed successfully. Apr 14 04:37:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-92d47c8b-2bbd-4ad5-8baa-a644070fbf09 tempest-TestStampPattern-267011728 None] Lock "cinder-63106e01-f69c-423b-87a5-a3c6b2f0ea0e-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] create export for volume: 495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] ensure volume 495f173c-6873-42b6-a0fe-42da67f3aa75 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] check if targe iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] create target and attach volume 495f173c-6873-42b6-a0fe-42da67f3aa75 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] create target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] atach volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 to target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:37:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3132643462623363', 'lun': 0, 'mode': 'wt', 'name': 'v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'prod_id': 'Storage', 'scsi_id': '12d4bb3c395f8b29'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] add credentails to target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:37:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tLxSpwaP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] initialize_connection for 495f173c-6873-42b6-a0fe-42da67f3aa75 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:37:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLxSpwaP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5a96efd1-e24e-41bb-aed3-6469de3a07a1'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:37:22 user cinder-volume[73393]: INFO cinder.volume.manager [req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 req-69f44867-ff3a-46f8-8c1e-f31bc0fa686d tempest-TestVolumeBootPattern-1780160917 None] attachment_update completed successfully. Apr 14 04:37:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:37:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:37:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:37:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:37:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:37:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114217697280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:37:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:37:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:37:32 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=35,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=40,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Acquiring lock "cinder-cd931337-f058-4d2e-bb9b-21d50e96a28b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Lock "cinder-cd931337-f058-4d2e-bb9b-21d50e96a28b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] remove_export for volume: cd931337-f058-4d2e-bb9b-21d50e96a28b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-292530258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cd931337-f058-4d2e-bb9b-21d50e96a28b,launched_at=2023-04-14T04:30:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6175a4372245a4a57dca1f12f7f007',provider_auth='CHAP KfcZYljW Ki2Z5ojLs13T8y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:30:10Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:38:03Z,updated_at=2023-04-14T04:38:03Z,use_quota=True,user_id='ebe3f41b95824cd78193d0bbe206a66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] detach volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b from target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns/v_cd931337-f058-4d2e-bb9b-21d50e96a28b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b/luns/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] failed to remove resource iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b because of JDSS resource v_cd931337-f058-4d2e-bb9b-21d50e96a28b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] delete target: iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] delete target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] failed to remove resource iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b because of JDSS resource iqn.2010-10.org.openstack:cd931337-f058-4d2e-bb9b-21d50e96a28b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] deleating volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] get snapshots for volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] get volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cd931337-f058-4d2e-bb9b-21d50e96a28b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448019', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '115721', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18303615666770334535', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '163840', 'logicalused': '1630208', 'compressratio': '15.30', 'rootcontext': 'none', 'default_scsi_id': '2bdaf5c0d569c0de', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217684992', 'san:volume_id': '2bdaf5c0d569c0de70e8ad80558c43efc8966c55', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '163840', 'objsetid': '89131', 'name': 'v_cd931337-f058-4d2e-bb9b-21d50e96a28b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '163840', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] delete volume:v_cd931337-f058-4d2e-bb9b-21d50e96a28b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] volume v_cd931337-f058-4d2e-bb9b-21d50e96a28b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.quota [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Created reservations ['2adfc705-2e1c-435e-8857-ceb252ed9eea', 'ea7b827c-aa1f-4c1f-975c-309b587e8514', '3c95d68c-3bb7-4f73-b966-b4be859a4d02', '5227b188-3803-4cbf-951b-fea6b1804034'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Geting {'code': 200, 'error': None, 'data': {'available': '114217885696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.manager [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:38:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Deleted volume successfully. Apr 14 04:38:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f51fdaed-b531-4f05-a52e-39340b570bdf tempest-TestStampPattern-267011728 None] Lock "cinder-cd931337-f058-4d2e-bb9b-21d50e96a28b-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (ca99c736-53a0-4356-b701-305406f21477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0881e4b6-41cd-4943-aac5-34c9009f0440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0881e4b6-41cd-4943-aac5-34c9009f0440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-878816237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edb399ae-e20a-4ef1-afda-86a7b094c40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:38:15Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf1a594-61f8-4d3a-99d6-ec9eec31ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf1a594-61f8-4d3a-99d6-ec9eec31ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67da1c7c-ade7-46b2-875a-e67b32d5a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67da1c7c-ade7-46b2-875a-e67b32d5a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb399ae-e20a-4ef1-afda-86a7b094c40b', 'volume_name': 'volume-edb399ae-e20a-4ef1-afda-86a7b094c40b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d2002f-3ba1-4385-a67e-950d2419426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d2002f-3ba1-4385-a67e-950d2419426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe7d031-c199-4299-a340-df4d95bf0f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Volume edb399ae-e20a-4ef1-afda-86a7b094c40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb399ae-e20a-4ef1-afda-86a7b094c40b', 'volume_size': 1} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] creating volume v_edb399ae-e20a-4ef1-afda-86a7b094c40b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] create volume {'name': 'v_edb399ae-e20a-4ef1-afda-86a7b094c40b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (5a47904b-511b-442c-9af4-8ce0dbce8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bf3d3c-52ad-4ca7-802f-b343acdc3881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bf3d3c-52ad-4ca7-802f-b343acdc3881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1093693487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=144dc6d4-f54b-42c7-ae63-a11ce879eb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:38:15Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a24bb40-131a-4c6e-a8dc-6a9132175554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a24bb40-131a-4c6e-a8dc-6a9132175554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39672be2-dae1-4f48-b76b-5d76842fbad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39672be2-dae1-4f48-b76b-5d76842fbad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'volume_name': 'volume-144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfbb80a-1012-42da-8b5e-cd8a0a3c14be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfbb80a-1012-42da-8b5e-cd8a0a3c14be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7259f44b-fc41-446b-9cb1-6287f193b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Volume 144dc6d4-f54b-42c7-ae63-a11ce879eb93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'volume_size': 1} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] creating volume v_144dc6d4-f54b-42c7-ae63-a11ce879eb93. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] create volume {'name': 'v_144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (e24dbc99-d002-4053-b4b0-05b1cd4adc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d370e5-06e1-47e3-b436-b4a215a9337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d370e5-06e1-47e3-b436-b4a215a9337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104581612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6f6a30f4-e823-45e5-acbf-33fcdc6eff61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:38:16Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd66230-8683-4707-9d6c-b6e5bb963e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd66230-8683-4707-9d6c-b6e5bb963e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0c9fba-d6ff-4021-86d6-2b4181acbacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0c9fba-d6ff-4021-86d6-2b4181acbacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'volume_name': 'volume-6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3ef8d-844d-4bd0-a84e-8502e7270791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3ef8d-844d-4bd0-a84e-8502e7270791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126308f7-0424-426f-9195-89dc3b24c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Volume 6f6a30f4-e823-45e5-acbf-33fcdc6eff61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'volume_size': 1} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] creating volume v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] create volume {'name': 'v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (1c07b4f6-1d35-4471-ab8e-f2c83665a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f03b97-8b96-432c-be67-6d7bb5977953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f03b97-8b96-432c-be67-6d7bb5977953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1675725132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2bfe6f22-9369-49a9-aa21-c2c981db5473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:38:16Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6a58de-092e-43df-bead-1656aa8c8d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6a58de-092e-43df-bead-1656aa8c8d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dc4a09-1aec-4f5e-be59-d3b9eff3692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dc4a09-1aec-4f5e-be59-d3b9eff3692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bfe6f22-9369-49a9-aa21-c2c981db5473', 'volume_name': 'volume-2bfe6f22-9369-49a9-aa21-c2c981db5473', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f311ed-698c-4018-84e0-5d6b00c5cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f311ed-698c-4018-84e0-5d6b00c5cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3b3f9a-2cdc-433d-934a-f9b8bd99b773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Volume 2bfe6f22-9369-49a9-aa21-c2c981db5473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bfe6f22-9369-49a9-aa21-c2c981db5473', 'volume_size': 1} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] creating volume v_2bfe6f22-9369-49a9-aa21-c2c981db5473. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] create volume {'name': 'v_2bfe6f22-9369-49a9-aa21-c2c981db5473', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (8ce5695e-96b6-4a74-94c4-5ee070693e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3b08a4-2dff-4710-a472-c65ff9d36535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3b08a4-2dff-4710-a472-c65ff9d36535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628028686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ff18fd81-35ed-4e85-a8bf-d4bb043c36ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:38:16Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b80fc9-356f-4358-862f-1e58b88885b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b80fc9-356f-4358-862f-1e58b88885b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403ef52b-bc65-4f09-914a-ea09b0e03231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403ef52b-bc65-4f09-914a-ea09b0e03231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'volume_name': 'volume-ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c239246b-b614-404b-afaf-a48aa1b225e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c239246b-b614-404b-afaf-a48aa1b225e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167585a2-9af4-4736-ad33-90f7943a1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Volume ff18fd81-35ed-4e85-a8bf-d4bb043c36ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'volume_size': 1} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] creating volume v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] create volume {'name': 'v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_edb399ae-e20a-4ef1-afda-86a7b094c40b', 'is_clone': False, 'name': 'v_edb399ae-e20a-4ef1-afda-86a7b094c40b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe7d031-c199-4299-a340-df4d95bf0f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb399ae-e20a-4ef1-afda-86a7b094c40b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a08ee0-1633-4360-8ecc-3b75198b39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Volume volume-edb399ae-e20a-4ef1-afda-86a7b094c40b (edb399ae-e20a-4ef1-afda-86a7b094c40b): created successfully Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a08ee0-1633-4360-8ecc-3b75198b39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (ca99c736-53a0-4356-b701-305406f21477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-607d5042-0112-448f-b143-7d8752350285 tempest-CreateVolumesFromImageTest-1257588266 None] Created volume successfully. Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'is_clone': False, 'name': 'v_144dc6d4-f54b-42c7-ae63-a11ce879eb93'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7259f44b-fc41-446b-9cb1-6287f193b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f65714-0af0-4e95-89c6-35b182538631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Volume volume-144dc6d4-f54b-42c7-ae63-a11ce879eb93 (144dc6d4-f54b-42c7-ae63-a11ce879eb93): created successfully Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f65714-0af0-4e95-89c6-35b182538631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (5a47904b-511b-442c-9af4-8ce0dbce8b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-be3efd9e-86ea-4c4c-8105-c2a81fe51f9f tempest-CreateVolumesFromImageTest-1257588266 None] Created volume successfully. Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'is_clone': False, 'name': 'v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126308f7-0424-426f-9195-89dc3b24c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30466fe7-e77c-4719-b439-f653a080165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Volume volume-6f6a30f4-e823-45e5-acbf-33fcdc6eff61 (6f6a30f4-e823-45e5-acbf-33fcdc6eff61): created successfully Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30466fe7-e77c-4719-b439-f653a080165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (e24dbc99-d002-4053-b4b0-05b1cd4adc25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a3dd8f33-d096-40e7-a4c7-48cd17d99434 tempest-CreateVolumesFromImageTest-1257588266 None] Created volume successfully. Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2bfe6f22-9369-49a9-aa21-c2c981db5473', 'is_clone': False, 'name': 'v_2bfe6f22-9369-49a9-aa21-c2c981db5473'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3b3f9a-2cdc-433d-934a-f9b8bd99b773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bfe6f22-9369-49a9-aa21-c2c981db5473', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88306420-5046-40fd-8c62-e96cd3326619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:17 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Volume volume-2bfe6f22-9369-49a9-aa21-c2c981db5473 (2bfe6f22-9369-49a9-aa21-c2c981db5473): created successfully Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88306420-5046-40fd-8c62-e96cd3326619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (1c07b4f6-1d35-4471-ab8e-f2c83665a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:17 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5c1e74b0-726b-4e62-bfe4-9b388bfd0468 tempest-CreateVolumesFromImageTest-1257588266 None] Created volume successfully. Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'is_clone': False, 'name': 'v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167585a2-9af4-4736-ad33-90f7943a1039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abde0f4e-282b-4fb1-88a8-0725d5a57e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:38:17 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Volume volume-ff18fd81-35ed-4e85-a8bf-d4bb043c36ec (ff18fd81-35ed-4e85-a8bf-d4bb043c36ec): created successfully Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abde0f4e-282b-4fb1-88a8-0725d5a57e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:38:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Flow 'volume_create_manager' (8ce5695e-96b6-4a74-94c4-5ee070693e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:38:17 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e04cb8b5-2b85-4ae0-9f16-8840e04bf3f6 tempest-CreateVolumesFromImageTest-1257588266 None] Created volume successfully. Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.coordination [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Acquiring lock "cinder-ff18fd81-35ed-4e85-a8bf-d4bb043c36ec-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.coordination [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-ff18fd81-35ed-4e85-a8bf-d4bb043c36ec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] remove_export for volume: ff18fd81-35ed-4e85-a8bf-d4bb043c36ec. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628028686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ff18fd81-35ed-4e85-a8bf-d4bb043c36ec,launched_at=2023-04-14T04:38:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth='CHAP wiymcpoE Q8OzFwlTGI7JeY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:16Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:38:19Z,updated_at=2023-04-14T04:38:19Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec from target iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec/luns/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec/luns/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec/luns/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec/luns/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec because of JDSS resource v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] delete target: iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] delete target iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec because of JDSS resource iqn.2010-10.org.openstack:ff18fd81-35ed-4e85-a8bf-d4bb043c36ec DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] deleating volume v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] get snapshots for volume v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] get volume v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448505', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116065', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8915107214111031587', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '41b172275121bca9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217426944', 'san:volume_id': '41b172275121bca97a84f36269fdbeedb04920c8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89894', 'name': 'v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] delete volume:v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] volume v_ff18fd81-35ed-4e85-a8bf-d4bb043c36ec deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.quota [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Created reservations ['4603574f-57a4-4f7d-a7d7-5c848df8e8ce', '1aa0701e-d6d4-4a97-9020-ab12caef361b', '02881257-a6de-4036-b312-feeb505259f2', 'a5eb5ecf-1a57-4770-bb79-1ab31cf71f61'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Acquiring lock "cinder-2bfe6f22-9369-49a9-aa21-c2c981db5473-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'available': '114217508864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.manager [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-2bfe6f22-9369-49a9-aa21-c2c981db5473-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:38:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Deleted volume successfully. Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-40a28203-cfe4-4c7f-b5a3-1eb2f42a9923 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-ff18fd81-35ed-4e85-a8bf-d4bb043c36ec-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] remove_export for volume: 2bfe6f22-9369-49a9-aa21-c2c981db5473. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1675725132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2bfe6f22-9369-49a9-aa21-c2c981db5473,launched_at=2023-04-14T04:38:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth='CHAP RduDhzvK IvA2CwpblP0jFO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:16Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:38:22Z,updated_at=2023-04-14T04:38:22Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] detach volume v_2bfe6f22-9369-49a9-aa21-c2c981db5473 from target iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473/luns/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473/luns/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473/luns/v_2bfe6f22-9369-49a9-aa21-c2c981db5473'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473/luns/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 because of JDSS resource v_2bfe6f22-9369-49a9-aa21-c2c981db5473 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] delete target: iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] delete target iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 because of JDSS resource iqn.2010-10.org.openstack:2bfe6f22-9369-49a9-aa21-c2c981db5473 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] deleating volume v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] get snapshots for volume v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] get volume v_2bfe6f22-9369-49a9-aa21-c2c981db5473 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2bfe6f22-9369-49a9-aa21-c2c981db5473', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448505', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116061', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9144455035782115553', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '09971961480bbda5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217508864', 'san:volume_id': '09971961480bbda51119222972251c6b14c0c6e0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89887', 'name': 'v_2bfe6f22-9369-49a9-aa21-c2c981db5473', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] delete volume:v_2bfe6f22-9369-49a9-aa21-c2c981db5473 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] terminate connection for 9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:38:23 user cinder-volume[73393]: INFO cinder.volume.manager [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Terminate volume connection completed successfully. Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Deleting attachment 5ae6bc76-75a1-4f44-99a1-fdb9bf96b0ef. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] remove_export for volume: 9108333c-dbbf-4edb-a2b5-c6f034073970. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:32:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9108333c-dbbf-4edb-a2b5-c6f034073970,launched_at=2023-04-14T04:32:54Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='d5995b934b0546c0983387e46e3b3df4',provider_auth='CHAP deafxyMo CZhMd6URQujpsX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:32:50Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:33:00Z,use_quota=True,user_id='6ec7103e06e643a6b9b2c908ba8d7b06',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] detach volume v_9108333c-dbbf-4edb-a2b5-c6f034073970 from target iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/luns/v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/luns/v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970/luns/v_9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] delete target: iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] delete target iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 req-e2d7e6dd-00de-4f78-a567-66cbf5851912 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] target iqn.2010-10.org.openstack:9108333c-dbbf-4edb-a2b5-c6f034073970 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2bfe6f22-9369-49a9-aa21-c2c981db5473 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] volume v_2bfe6f22-9369-49a9-aa21-c2c981db5473 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=64,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.quota [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Created reservations ['e69d06f8-d27e-43d5-999b-d80c3dabe1f1', 'd9322bec-cca6-4a16-b96c-f6736eb7168e', '0fca2f6f-f3ef-4435-8c0d-4fd6cbb7a250', '0a7740e1-6414-47a8-9b96-9bdfd6012958'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114217508864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:38:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Acquiring lock "cinder-6f6a30f4-e823-45e5-acbf-33fcdc6eff61-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-6f6a30f4-e823-45e5-acbf-33fcdc6eff61-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] remove_export for volume: 6f6a30f4-e823-45e5-acbf-33fcdc6eff61. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104581612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6f6a30f4-e823-45e5-acbf-33fcdc6eff61,launched_at=2023-04-14T04:38:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth='CHAP FBbQkAHS w8a1NPdloTMgXD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:16Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:38:25Z,updated_at=2023-04-14T04:38:25Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 from target iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61/luns/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61/luns/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61/luns/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61/luns/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 because of JDSS resource v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] delete target: iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] delete target iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 because of JDSS resource iqn.2010-10.org.openstack:6f6a30f4-e823-45e5-acbf-33fcdc6eff61 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] deleating volume v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] get snapshots for volume v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'available': '114217590784', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:38:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Deleted volume successfully. Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f46fd137-b1e9-46b0-82cb-2ff6cea36cae tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-2bfe6f22-9369-49a9-aa21-c2c981db5473-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] get volume v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448505', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116057', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11878636185409341215', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '826c307f11d4f437', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217590784', 'san:volume_id': '826c307f11d4f43718c11c1ef8e49effeb4d1198', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90114', 'name': 'v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] delete volume:v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] volume v_6f6a30f4-e823-45e5-acbf-33fcdc6eff61 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:38:27 user cinder-volume[73393]: DEBUG cinder.quota [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Created reservations ['22c2d4d8-02c0-48c6-9959-9152253974d5', 'c7c4db37-fe67-4347-9192-3301dd6763df', 'd7fa0a86-87f7-4052-91f3-10ba3f038475', 'f771a0c6-e484-4976-9c6f-9a83eb96b755'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:38:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:38:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:38:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'available': '114217672704', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.manager [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:38:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Deleted volume successfully. Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-49ac749a-7e85-4f54-a3cd-fb77d8b6e1b2 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-6f6a30f4-e823-45e5-acbf-33fcdc6eff61-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Acquiring lock "cinder-144dc6d4-f54b-42c7-ae63-a11ce879eb93-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-144dc6d4-f54b-42c7-ae63-a11ce879eb93-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] remove_export for volume: 144dc6d4-f54b-42c7-ae63-a11ce879eb93. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1093693487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=144dc6d4-f54b-42c7-ae63-a11ce879eb93,launched_at=2023-04-14T04:38:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth='CHAP HvVSoKFc yEM5HcdvIODqLX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:15Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:38:28Z,updated_at=2023-04-14T04:38:28Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 from target iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93/luns/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93/luns/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93/luns/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93/luns/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 because of JDSS resource v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] delete target: iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] delete target iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 because of JDSS resource iqn.2010-10.org.openstack:144dc6d4-f54b-42c7-ae63-a11ce879eb93 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] deleating volume v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] get snapshots for volume v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] get volume v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448504', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116054', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '266396011030286086', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b78bd48afadf620b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217672704', 'san:volume_id': 'b78bd48afadf620b3b3ca2345cbcbc05b0c77d92', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89878', 'name': 'v_144dc6d4-f54b-42c7-ae63-a11ce879eb93', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] delete volume:v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] volume v_144dc6d4-f54b-42c7-ae63-a11ce879eb93 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:38:30 user cinder-volume[73393]: DEBUG cinder.quota [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Created reservations ['aec37c77-eb70-4d31-a40e-bc5271ea758a', 'bb2b8d1d-f071-4898-b1ea-743467dc19c2', 'eb9ff771-d8ad-4b0d-a514-517f1699ac63', '7d9aad34-828a-4ea1-8ee9-0ff8f66b90bf'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:38:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:38:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:38:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'available': '114217742336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.manager [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:38:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Deleted volume successfully. Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-289f6d04-14f2-4a45-9b63-b5ca682f9f62 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-144dc6d4-f54b-42c7-ae63-a11ce879eb93-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Acquiring lock "cinder-edb399ae-e20a-4ef1-afda-86a7b094c40b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-edb399ae-e20a-4ef1-afda-86a7b094c40b-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] remove_export for volume: edb399ae-e20a-4ef1-afda-86a7b094c40b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-878816237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edb399ae-e20a-4ef1-afda-86a7b094c40b,launched_at=2023-04-14T04:38:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802b2702c5c442cba6bccde09b445a4a',provider_auth='CHAP gGizqxkc bQgN5Ciy32HB6L',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:38:15Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:38:32Z,updated_at=2023-04-14T04:38:32Z,use_quota=True,user_id='c2a1ed8939384a8e8c4df70a26136959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] detach volume v_edb399ae-e20a-4ef1-afda-86a7b094c40b from target iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b/luns/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b/luns/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b/luns/v_edb399ae-e20a-4ef1-afda-86a7b094c40b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b/luns/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b because of JDSS resource v_edb399ae-e20a-4ef1-afda-86a7b094c40b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] delete target: iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] delete target iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] failed to remove resource iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b because of JDSS resource iqn.2010-10.org.openstack:edb399ae-e20a-4ef1-afda-86a7b094c40b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] deleating volume v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] get snapshots for volume v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] get volume v_edb399ae-e20a-4ef1-afda-86a7b094c40b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_edb399ae-e20a-4ef1-afda-86a7b094c40b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448504', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116051', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12488287617122235500', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '032cd84c105b3f83', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217742336', 'san:volume_id': '032cd84c105b3f838ed5f81769dafb88887ed9c7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89870', 'name': 'v_edb399ae-e20a-4ef1-afda-86a7b094c40b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] delete volume:v_edb399ae-e20a-4ef1-afda-86a7b094c40b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edb399ae-e20a-4ef1-afda-86a7b094c40b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] volume v_edb399ae-e20a-4ef1-afda-86a7b094c40b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:38:34 user cinder-volume[73393]: DEBUG cinder.quota [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Created reservations ['8f6dc220-410a-4bfa-b901-7c97c04fe776', '7244c490-5572-4fd8-a312-66e1502f922e', 'cc5a946e-d3f5-4d88-9d78-b671b5c26774', '6e28abe8-c1db-447a-9827-bccd3c5b330a'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:38:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:38:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:38:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:38:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:38:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Geting {'code': 200, 'error': None, 'data': {'available': '114217824256', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:38:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:38:35 user cinder-volume[73393]: DEBUG cinder.manager [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:38:35 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Deleted volume successfully. Apr 14 04:38:35 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5dc7d345-c5a5-4658-8584-9e768ed58ce4 tempest-CreateVolumesFromImageTest-1257588266 None] Lock "cinder-edb399ae-e20a-4ef1-afda-86a7b094c40b-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:38:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=28,cinder:SELECT=38,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:57 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=6,cinder:SELECT=49,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] create snapshot 98c8ba1d-cb52-46fa-9bf2-35f0db14502f for volume 495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:39:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] cloning v_495f173c-6873-42b6-a0fe-42da67f3aa75 to s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:39:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] create snapshot s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:39:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_98c8ba1d-cb52-46fa-9bf2-35f0db14502f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] create volume s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f from snapshot s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:39:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_495f173c-6873-42b6-a0fe-42da67f3aa75@s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f', 'is_clone': True, 'full_name': 'Pool-0/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f', 'name': 's_98c8ba1d-cb52-46fa-9bf2-35f0db14502f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] volume s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:39:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7df3b728-36a0-448d-8522-5ec40ff51ad5 tempest-TestVolumeBootPattern-1780160917 None] Create snapshot completed successfully Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (421abe47-9371-4058-a32b-a7f5024f8dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1d7206-e3a9-48de-917d-53da9510db8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1d7206-e3a9-48de-917d-53da9510db8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-292101750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=350da73c-f3b8-4777-b0d2-56bc054366d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98c8ba1d-cb52-46fa-9bf2-35f0db14502f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:39:14Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866d3670-0af5-4eb2-9fec-c1ba9c71be93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866d3670-0af5-4eb2-9fec-c1ba9c71be93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f216c70-13a9-4261-b81b-45e37c29319f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f216c70-13a9-4261-b81b-45e37c29319f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '350da73c-f3b8-4777-b0d2-56bc054366d1', 'volume_name': 'volume-350da73c-f3b8-4777-b0d2-56bc054366d1', 'volume_size': 1, 'snapshot_id': '98c8ba1d-cb52-46fa-9bf2-35f0db14502f'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f272b97a-e000-4045-8759-53303f6f0b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f272b97a-e000-4045-8759-53303f6f0b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875eefa7-2117-43f6-91bc-2ba8a9929dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:39:14 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Volume 350da73c-f3b8-4777-b0d2-56bc054366d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-350da73c-f3b8-4777-b0d2-56bc054366d1', 'volume_size': 1, 'snapshot_id': '98c8ba1d-cb52-46fa-9bf2-35f0db14502f'} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] create volume 350da73c-f3b8-4777-b0d2-56bc054366d1 from snapshot 98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] cloning s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f to v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] create snapshot v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_350da73c-f3b8-4777-b0d2-56bc054366d1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] create volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 from snapshot v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:39:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f@v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'is_clone': True, 'full_name': 'Pool-0/v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'name': 'v_350da73c-f3b8-4777-b0d2-56bc054366d1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] get volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f@v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448564', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '116095', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15409422536342177761', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3bd140ba6a79949a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217709568', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90252', 'name': 'v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Marking volume 350da73c-f3b8-4777-b0d2-56bc054366d1 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Copying metadata from snapshot 98c8ba1d-cb52-46fa-9bf2-35f0db14502f to 350da73c-f3b8-4777-b0d2-56bc054366d1. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875eefa7-2117-43f6-91bc-2ba8a9929dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350da73c-f3b8-4777-b0d2-56bc054366d1', 'volume_size': 1, 'snapshot_id': '98c8ba1d-cb52-46fa-9bf2-35f0db14502f'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08c5d67-3981-4916-a93f-11e74b3d355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:39:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Volume volume-350da73c-f3b8-4777-b0d2-56bc054366d1 (350da73c-f3b8-4777-b0d2-56bc054366d1): created successfully Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08c5d67-3981-4916-a93f-11e74b3d355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:39:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Flow 'volume_create_manager' (421abe47-9371-4058-a32b-a7f5024f8dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:39:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3ca3091b-0327-4a75-9a2a-bff9a5ffdd33 tempest-TestVolumeBootPattern-1780160917 None] Created volume successfully. Apr 14 04:39:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=25,cinder:UPDATE=4,cinder:INSERT=11 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] create export for volume: 350da73c-f3b8-4777-b0d2-56bc054366d1. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] ensure volume 350da73c-f3b8-4777-b0d2-56bc054366d1 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] check if targe iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] create target and attach volume 350da73c-f3b8-4777-b0d2-56bc054366d1 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] create target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] atach volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 to target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:39:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3362643134306261', 'lun': 0, 'mode': 'wt', 'name': 'v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'prod_id': 'Storage', 'scsi_id': '3bd140ba6a79949a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] add credentails to target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:39:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 201, 'error': None, 'data': {'name': 'utAhjSFl'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] initialize_connection for 350da73c-f3b8-4777-b0d2-56bc054366d1 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:39:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utAhjSFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '858be4aa-e57b-41f7-baa4-4bb0174a0dbd'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:39:23 user cinder-volume[73393]: INFO cinder.volume.manager [req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 req-af71e23d-9e26-414b-93c6-18ba5a437008 tempest-TestVolumeBootPattern-1780160917 None] attachment_update completed successfully. Apr 14 04:39:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:39:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:39:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:39:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114217566208', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:39:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=27,cinder:UPDATE=10,cinder:INSERT=13,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] terminate connection for 5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:39:33 user cinder-volume[73393]: INFO cinder.volume.manager [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Terminate volume connection completed successfully. Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Deleting attachment 9fdd36f5-c84d-4582-a392-992dcb0830ca. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] remove_export for volume: 5615b9ab-7102-4d44-a55e-0e2581c39757. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2063819679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5615b9ab-7102-4d44-a55e-0e2581c39757,launched_at=2023-04-14T04:36:37Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth='CHAP TgIjxlbS 2IHuMX4lni6aBR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:36:36Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:39:32Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] detach volume v_5615b9ab-7102-4d44-a55e-0e2581c39757 from target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] delete target: iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:39:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] delete target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:39:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5779441c-e5a7-4390-9bce-59c49cafb02a req-fe1fb56b-9e15-452c-ac8b-0bad2bc59a6b tempest-AttachVolumeNegativeTest-1197484356 None] target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] terminate connection for 992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:39:43 user cinder-volume[73393]: INFO cinder.volume.manager [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Terminate volume connection completed successfully. Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Deleting attachment 330200a1-d9ad-42ed-be96-0bc76ac890b7. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1153378244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=992a3f86-d313-4b1e-9491-3008be037269,launched_at=2023-04-14T04:33:04Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP sPgLhMjz UdoNt3CFcEDRpl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:33:01Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:35:14Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] detach volume v_992a3f86-d313-4b1e-9491-3008be037269 from target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-cac81a13-6cf1-49c1-a532-60226ee26607 tempest-ServerActionsTestJSON-1048786641 None] target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.coordination [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Acquiring lock "cinder-992a3f86-d313-4b1e-9491-3008be037269-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.coordination [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-992a3f86-d313-4b1e-9491-3008be037269-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1153378244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=992a3f86-d313-4b1e-9491-3008be037269,launched_at=2023-04-14T04:33:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP sPgLhMjz UdoNt3CFcEDRpl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:33:01Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:39:44Z,updated_at=2023-04-14T04:39:44Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] detach volume v_992a3f86-d313-4b1e-9491-3008be037269 from target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269/luns/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] failed to remove resource iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 because of JDSS resource v_992a3f86-d313-4b1e-9491-3008be037269 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] failed to remove resource iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 because of JDSS resource iqn.2010-10.org.openstack:992a3f86-d313-4b1e-9491-3008be037269 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] deleating volume v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] get snapshots for volume v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] get volume v_992a3f86-d313-4b1e-9491-3008be037269 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_992a3f86-d313-4b1e-9491-3008be037269', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_992a3f86-d313-4b1e-9491-3008be037269', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448191', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26116096', 'sharesmb': None, 'createtxg': '115919', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7563655901441508740', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10137600', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': 'e1c3d039cc119196', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114217275392', 'san:volume_id': 'e1c3d039cc119196bc4fb4dc708d45f94f40dfd6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10137600', 'objsetid': '89738', 'name': 'v_992a3f86-d313-4b1e-9491-3008be037269', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10137600', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] delete snapshot v_992a3f86-d313-4b1e-9491-3008be037269 of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_992a3f86-d313-4b1e-9491-3008be037269 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] snapshot v_992a3f86-d313-4b1e-9491-3008be037269 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.quota [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Created reservations ['215d81d8-ea04-4e34-a4b5-e7f702da25e4', 'e263e568-814b-43cf-b391-9abc989ba90b', '96718638-f697-487d-83cb-8bd9b7e7a19f', '3a62c789-eae2-464e-9f73-c416116caec8'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227486720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:39:46 user cinder-volume[73393]: DEBUG cinder.manager [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:39:47 user cinder-volume[73393]: INFO cinder.volume.manager [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Deleted volume successfully. Apr 14 04:39:47 user cinder-volume[73393]: DEBUG cinder.coordination [req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 req-304a3783-46eb-467f-a769-0006ce1114cc tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-992a3f86-d313-4b1e-9491-3008be037269-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:39:48 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=35,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] terminate connection for 6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:40:04 user cinder-volume[73393]: INFO cinder.volume.manager [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Terminate volume connection completed successfully. Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Deleting attachment 2931a803-f7ab-4f6c-b752-edcd2987b0d0. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] remove_export for volume: 6e31b954-88d8-448b-bbb7-f19007a51866. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:24:16Z,deleted=False,deleted_at=None,display_description='',display_name='3df97db3-fd6c-4be6-af32-7cde9dbcce75-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6e31b954-88d8-448b-bbb7-f19007a51866,launched_at=2023-04-14T04:24:18Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='d5995b934b0546c0983387e46e3b3df4',provider_auth='CHAP YCyASkTZ wr7LKYAHm3xE0S',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:24:17Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:24:26Z,use_quota=True,user_id='6ec7103e06e643a6b9b2c908ba8d7b06',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] detach volume v_6e31b954-88d8-448b-bbb7-f19007a51866 from target iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/luns/v_6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/luns/v_6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866/luns/v_6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] delete target: iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] delete target iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:40:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:40:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:40:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ee648a24-65c5-441a-a367-c24fa9284c53 req-026fb54f-87fd-4712-b246-23c80a1ac3c1 tempest-ServerBootFromVolumeStableRescueTest-247821842 None] target iqn.2010-10.org.openstack:6e31b954-88d8-448b-bbb7-f19007a51866 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:40:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:40:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:40:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:40:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:40:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:40:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114227453952', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:40:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:40:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:40:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=10 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] terminate connection for 350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:41:12 user cinder-volume[73393]: INFO cinder.volume.manager [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Terminate volume connection completed successfully. Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Deleting attachment 858be4aa-e57b-41f7-baa4-4bb0174a0dbd. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 350da73c-f3b8-4777-b0d2-56bc054366d1. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-292101750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=350da73c-f3b8-4777-b0d2-56bc054366d1,launched_at=2023-04-14T04:39:16Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP utAhjSFl 6nMN3ATrepZ0vP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:39:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=98c8ba1d-cb52-46fa-9bf2-35f0db14502f,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:39:24Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 from target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:41:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:41:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d086675a-6290-4d70-9c71-f2762313b8cd req-ed82dea0-933b-4818-a99a-204907756401 tempest-TestVolumeBootPattern-1780160917 None] target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Acquiring lock "cinder-9cdf2c58-c295-483e-b766-13e01129ede2-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-9cdf2c58-c295-483e-b766-13e01129ede2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1226443700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9cdf2c58-c295-483e-b766-13e01129ede2,launched_at=2023-04-14T04:25:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP MjAZDWGc KyeNwxZHQq4i1a',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:25:24Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:41:22Z,updated_at=2023-04-14T04:41:22Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] detach volume v_9cdf2c58-c295-483e-b766-13e01129ede2 from target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2/luns/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] failed to remove resource iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 because of JDSS resource v_9cdf2c58-c295-483e-b766-13e01129ede2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] failed to remove resource iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 because of JDSS resource iqn.2010-10.org.openstack:9cdf2c58-c295-483e-b766-13e01129ede2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] deleating volume v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] get snapshots for volume v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] get volume v_9cdf2c58-c295-483e-b766-13e01129ede2 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9cdf2c58-c295-483e-b766-13e01129ede2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447733', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '115363', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7981955538855890048', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6adfffd359b42273', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227453952', 'san:volume_id': '6adfffd359b422734286ec08d9f7ee2b29a73336', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89357', 'name': 'v_9cdf2c58-c295-483e-b766-13e01129ede2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] delete volume:v_9cdf2c58-c295-483e-b766-13e01129ede2 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cdf2c58-c295-483e-b766-13e01129ede2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] volume v_9cdf2c58-c295-483e-b766-13e01129ede2 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.quota [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Created reservations ['b376c192-476e-44c2-9417-26785a88b06b', 'a25afaa4-a063-4d27-aa7d-ce745365ed4e', '522a95ed-583d-438e-a45a-59e3df20157d', '67e9f484-842e-4dd6-bfca-62def1d96694'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114227453952', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:41:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227548160', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:41:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Deleted volume successfully. Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b9ccc94f-2711-48c8-bd56-a09f6f20ac0f tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-9cdf2c58-c295-483e-b766-13e01129ede2-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Acquiring lock "cinder-3e0082ad-1ad0-4980-a066-6017f65fce9e-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-3e0082ad-1ad0-4980-a066-6017f65fce9e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] remove_export for volume: 3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1183423330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3e0082ad-1ad0-4980-a066-6017f65fce9e,launched_at=2023-04-14T04:20:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c14c332dfcc44b49ddf3cb482dd0d4c',provider_auth='CHAP YjWqRKtu lfA29KzFXS4idg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:20:27Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:41:25Z,updated_at=2023-04-14T04:41:25Z,use_quota=True,user_id='e35b3ae371cf4dd4b21e2999e58cd2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] detach volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e from target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e/luns/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] failed to remove resource iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e because of JDSS resource v_3e0082ad-1ad0-4980-a066-6017f65fce9e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] delete target: iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] delete target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] failed to remove resource iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e because of JDSS resource iqn.2010-10.org.openstack:3e0082ad-1ad0-4980-a066-6017f65fce9e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] deleating volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] get snapshots for volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] get volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3e0082ad-1ad0-4980-a066-6017f65fce9e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681447436', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114978', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15654772574155234360', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3b4b6f51086736b8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227548160', 'san:volume_id': '3b4b6f51086736b87e7bfe9f2c1c63af8636f41e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87146', 'name': 'v_3e0082ad-1ad0-4980-a066-6017f65fce9e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] delete volume:v_3e0082ad-1ad0-4980-a066-6017f65fce9e recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3e0082ad-1ad0-4980-a066-6017f65fce9e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] volume v_3e0082ad-1ad0-4980-a066-6017f65fce9e deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:41:27 user cinder-volume[73393]: DEBUG cinder.quota [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Created reservations ['090f4d67-c75f-41e4-baeb-4ed3b6a7affa', '22840ab6-9060-4a02-adf4-88e113b553de', '25807254-c4d9-45e3-ba74-ae745e9eb88b', '41bbcb75-9d72-4cca-8964-1da789d3f7d3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:41:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:41:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:41:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227654656', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:41:28 user cinder-volume[73393]: DEBUG cinder.manager [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:41:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Deleted volume successfully. Apr 14 04:41:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-4bc03dd1-e1cb-42c1-8f60-d215757fe926 tempest-ServerActionsTestJSON-1048786641 None] Lock "cinder-3e0082ad-1ad0-4980-a066-6017f65fce9e-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Flow 'volume_create_manager' (aeeacbb1-a964-4ac4-82b6-4ecace772f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca9127d-9167-413b-925f-e8001cdffdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca9127d-9167-413b-925f-e8001cdffdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-899640550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5dbd1e7d-3f46-4104-a106-e273736f0b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7cbf8498c84ac2b57bf415afdf77fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:41:35Z,use_quota=True,user_id='3a142e520a2045a5b01a8638e62fcbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195f031-af47-47f4-af21-e68b471953fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195f031-af47-47f4-af21-e68b471953fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55502f8-4d81-4c5e-a055-9cafa86f60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55502f8-4d81-4c5e-a055-9cafa86f60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbd1e7d-3f46-4104-a106-e273736f0b89', 'volume_name': 'volume-5dbd1e7d-3f46-4104-a106-e273736f0b89', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81ebc33-78d7-448d-9dca-163b5b650e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:34 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81ebc33-78d7-448d-9dca-163b5b650e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706b3e54-af20-4cf7-a231-b962598b3c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbd1e7d-3f46-4104-a106-e273736f0b89', 'volume_size': 1} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] creating volume v_5dbd1e7d-3f46-4104-a106-e273736f0b89. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] create volume {'name': 'v_5dbd1e7d-3f46-4104-a106-e273736f0b89', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5dbd1e7d-3f46-4104-a106-e273736f0b89', 'is_clone': False, 'name': 'v_5dbd1e7d-3f46-4104-a106-e273736f0b89'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706b3e54-af20-4cf7-a231-b962598b3c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbd1e7d-3f46-4104-a106-e273736f0b89', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1042572a-1f64-4b4d-85a2-47a0b4334ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Volume volume-5dbd1e7d-3f46-4104-a106-e273736f0b89 (5dbd1e7d-3f46-4104-a106-e273736f0b89): created successfully Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1042572a-1f64-4b4d-85a2-47a0b4334ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Flow 'volume_create_manager' (aeeacbb1-a964-4ac4-82b6-4ecace772f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:41:35 user cinder-volume[73393]: INFO cinder.volume.manager [req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 req-54dd6f40-cc5d-4b54-abda-b7aaac5dc889 tempest-VolumesSnapshotsTestJSON-491060007 None] Created volume successfully. Apr 14 04:41:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] create snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 for volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:41:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] cloning v_5dbd1e7d-3f46-4104-a106-e273736f0b89 to s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:41:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] create snapshot s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:41:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=40,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_6c294099-f4f2-4a87-bf5b-cdff61927080'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] create volume s_6c294099-f4f2-4a87-bf5b-cdff61927080 from snapshot s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:41:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5dbd1e7d-3f46-4104-a106-e273736f0b89@s_6c294099-f4f2-4a87-bf5b-cdff61927080', 'is_clone': True, 'full_name': 'Pool-0/s_6c294099-f4f2-4a87-bf5b-cdff61927080', 'name': 's_6c294099-f4f2-4a87-bf5b-cdff61927080'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] volume s_6c294099-f4f2-4a87-bf5b-cdff61927080 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=37,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:39 user cinder-volume[73393]: INFO cinder.volume.manager [req-0817196f-65ea-4c6e-9ca3-7daeb33d051c req-a1c713d9-bd2c-49cc-b44b-784e71208861 tempest-VolumesSnapshotsTestJSON-491060007 None] Create snapshot completed successfully Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.coordination [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Acquiring lock "cinder-6c294099-f4f2-4a87-bf5b-cdff61927080-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.coordination [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Lock "cinder-6c294099-f4f2-4a87-bf5b-cdff61927080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] deleating snapshot s_6c294099-f4f2-4a87-bf5b-cdff61927080. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] get snapshots for volume s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] get volume s_6c294099-f4f2-4a87-bf5b-cdff61927080 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5dbd1e7d-3f46-4104-a106-e273736f0b89@s_6c294099-f4f2-4a87-bf5b-cdff61927080', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_6c294099-f4f2-4a87-bf5b-cdff61927080', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448707', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116146', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1343006948527041285', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eb9c16219fb443c6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227609600', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '88653', 'name': 's_6c294099-f4f2-4a87-bf5b-cdff61927080', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] delete snapshot s_6c294099-f4f2-4a87-bf5b-cdff61927080 of volume v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots/s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots/s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots/s_6c294099-f4f2-4a87-bf5b-cdff61927080 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] snapshot s_6c294099-f4f2-4a87-bf5b-cdff61927080 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:41:41 user cinder-volume[73393]: DEBUG cinder.quota [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Created reservations ['26d0caf4-ecc3-451a-a4d7-c4a79b95e63d', 'ec687eb4-2cd1-41a8-a8bd-0631a027006f', 'e5006ba2-8c52-4dd1-b9f5-17f42c113ef3', 'd2a3c9de-382a-403e-84d4-c600164be4f5'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:41:41 user cinder-volume[73393]: INFO cinder.volume.manager [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Delete snapshot completed successfully. Apr 14 04:41:41 user cinder-volume[73393]: DEBUG cinder.coordination [req-e1284439-c5a8-418f-b01d-6c51c6edbe7c req-68ccd477-d07b-4d87-8209-b64968f23958 tempest-VolumesSnapshotsTestJSON-491060007 None] Lock "cinder-6c294099-f4f2-4a87-bf5b-cdff61927080-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.coordination [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Acquiring lock "cinder-5dbd1e7d-3f46-4104-a106-e273736f0b89-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.coordination [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Lock "cinder-5dbd1e7d-3f46-4104-a106-e273736f0b89-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] remove_export for volume: 5dbd1e7d-3f46-4104-a106-e273736f0b89. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-899640550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5dbd1e7d-3f46-4104-a106-e273736f0b89,launched_at=2023-04-14T04:41:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7cbf8498c84ac2b57bf415afdf77fa',provider_auth='CHAP WihxMXPF fpAntbukqW0mKo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:41:35Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:41:43Z,updated_at=2023-04-14T04:41:43Z,use_quota=True,user_id='3a142e520a2045a5b01a8638e62fcbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] detach volume v_5dbd1e7d-3f46-4104-a106-e273736f0b89 from target iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89/luns/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89/luns/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89/luns/v_5dbd1e7d-3f46-4104-a106-e273736f0b89'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89/luns/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] failed to remove resource iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 because of JDSS resource v_5dbd1e7d-3f46-4104-a106-e273736f0b89 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] delete target: iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] delete target iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] failed to remove resource iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 because of JDSS resource iqn.2010-10.org.openstack:5dbd1e7d-3f46-4104-a106-e273736f0b89 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] deleating volume v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] get snapshots for volume v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] get volume v_5dbd1e7d-3f46-4104-a106-e273736f0b89 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5dbd1e7d-3f46-4104-a106-e273736f0b89', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448704', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116140', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14125690183201818535', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f6b1711fa3f7de29', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227597312', 'san:volume_id': 'f6b1711fa3f7de29549fd1edccae952e668b0495', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89423', 'name': 'v_5dbd1e7d-3f46-4104-a106-e273736f0b89', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] delete volume:v_5dbd1e7d-3f46-4104-a106-e273736f0b89 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5dbd1e7d-3f46-4104-a106-e273736f0b89 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] volume v_5dbd1e7d-3f46-4104-a106-e273736f0b89 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.quota [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Created reservations ['76e7905e-00a0-43f7-805e-630707795e7c', 'f78cac47-3df6-4d24-9f42-baf17562c304', '63211118-7087-4076-aa57-ae289532e863', '81f80c21-7269-4dc7-a8d9-e2bda647f557'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227691520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.manager [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:41:45 user cinder-volume[73393]: INFO cinder.volume.manager [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Deleted volume successfully. Apr 14 04:41:45 user cinder-volume[73393]: DEBUG cinder.coordination [req-1e6446d0-8272-4846-a3fd-633c74667aa6 req-28757e0d-f312-4b34-a720-c3f18069dfff tempest-VolumesSnapshotsTestJSON-491060007 None] Lock "cinder-5dbd1e7d-3f46-4104-a106-e273736f0b89-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Flow 'volume_create_manager' (9bd2a749-9131-46c9-afd4-26ff3e00d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0167f272-db6f-4cc7-92fd-e34ae7e80a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0167f272-db6f-4cc7-92fd-e34ae7e80a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1766458157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=62ce5c78-2026-46a5-9777-4653e0953328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd1439f11f54fabb6c6c1808b84f971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:41:56Z,use_quota=True,user_id='6ac82f00456a49a78e00b97d1ad8f52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2247ffdb-4d53-4806-a520-2d9327a1e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2247ffdb-4d53-4806-a520-2d9327a1e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cafcbd1-92c7-43d6-9a24-4cbc6907a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cafcbd1-92c7-43d6-9a24-4cbc6907a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ce5c78-2026-46a5-9777-4653e0953328', 'volume_name': 'volume-62ce5c78-2026-46a5-9777-4653e0953328', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c5773e-b660-4f35-8188-1fb1921a07e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c5773e-b660-4f35-8188-1fb1921a07e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf546bd5-fe6b-4aac-a330-845ea5f4d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:56 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Volume 62ce5c78-2026-46a5-9777-4653e0953328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ce5c78-2026-46a5-9777-4653e0953328', 'volume_size': 1} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] creating volume v_62ce5c78-2026-46a5-9777-4653e0953328. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] create volume {'name': 'v_62ce5c78-2026-46a5-9777-4653e0953328', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_62ce5c78-2026-46a5-9777-4653e0953328', 'is_clone': False, 'name': 'v_62ce5c78-2026-46a5-9777-4653e0953328'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf546bd5-fe6b-4aac-a330-845ea5f4d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ce5c78-2026-46a5-9777-4653e0953328', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d23b10c-82d6-4e3a-b0bf-5588660cb78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:41:57 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Volume volume-62ce5c78-2026-46a5-9777-4653e0953328 (62ce5c78-2026-46a5-9777-4653e0953328): created successfully Apr 14 04:41:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d23b10c-82d6-4e3a-b0bf-5588660cb78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:41:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Flow 'volume_create_manager' (9bd2a749-9131-46c9-afd4-26ff3e00d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:41:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-903c2eaa-8ebd-4f40-b8b1-b26901d440e8 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Created volume successfully. Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.coordination [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Acquiring lock "cinder-62ce5c78-2026-46a5-9777-4653e0953328-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.coordination [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Lock "cinder-62ce5c78-2026-46a5-9777-4653e0953328-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] remove_export for volume: 62ce5c78-2026-46a5-9777-4653e0953328. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1766458157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=62ce5c78-2026-46a5-9777-4653e0953328,launched_at=2023-04-14T04:41:58Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='2fd1439f11f54fabb6c6c1808b84f971',provider_auth='CHAP jCYdnfks hr74KHEM6l90s1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:41:56Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:41:59Z,updated_at=2023-04-14T04:41:59Z,use_quota=True,user_id='6ac82f00456a49a78e00b97d1ad8f52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] detach volume v_62ce5c78-2026-46a5-9777-4653e0953328 from target iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328/luns/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328/luns/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328/luns/v_62ce5c78-2026-46a5-9777-4653e0953328'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328/luns/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] failed to remove resource iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 because of JDSS resource v_62ce5c78-2026-46a5-9777-4653e0953328 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] delete target: iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] delete target iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] failed to remove resource iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 because of JDSS resource iqn.2010-10.org.openstack:62ce5c78-2026-46a5-9777-4653e0953328 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] deleating volume v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] get snapshots for volume v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] get volume v_62ce5c78-2026-46a5-9777-4653e0953328 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:41:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_62ce5c78-2026-46a5-9777-4653e0953328', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448725', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116157', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11245689852556351104', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bda7d25ca1190a7d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227597312', 'san:volume_id': 'bda7d25ca1190a7d1624e3a6ffd8234eaca72f36', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89803', 'name': 'v_62ce5c78-2026-46a5-9777-4653e0953328', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] delete volume:v_62ce5c78-2026-46a5-9777-4653e0953328 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:42:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-350da73c-f3b8-4777-b0d2-56bc054366d1-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-350da73c-f3b8-4777-b0d2-56bc054366d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 350da73c-f3b8-4777-b0d2-56bc054366d1. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-292101750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=350da73c-f3b8-4777-b0d2-56bc054366d1,launched_at=2023-04-14T04:39:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP utAhjSFl 6nMN3ATrepZ0vP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:39:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=98c8ba1d-cb52-46fa-9bf2-35f0db14502f,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:42:01Z,updated_at=2023-04-14T04:42:01Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] detach volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 from target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns/v_350da73c-f3b8-4777-b0d2-56bc054366d1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1/luns/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 because of JDSS resource v_350da73c-f3b8-4777-b0d2-56bc054366d1 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 because of JDSS resource iqn.2010-10.org.openstack:350da73c-f3b8-4777-b0d2-56bc054366d1 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] deleating volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62ce5c78-2026-46a5-9777-4653e0953328 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] volume v_62ce5c78-2026-46a5-9777-4653e0953328 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.quota [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Created reservations ['d6288c31-bc29-4d89-b1cd-b8e7c02b0119', 'ae0fe49a-8ba9-4ac5-b65e-c2fec2b384e2', 'b04175d1-e84a-4b52-a094-98b64beb6ad1', 'a99ce2fb-0307-4803-80cc-238a2186149f'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] get volume v_350da73c-f3b8-4777-b0d2-56bc054366d1 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f@v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448564', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '116095', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15409422536342177761', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '266240', 'logicalused': '1097728', 'compressratio': '5.05', 'rootcontext': 'none', 'default_scsi_id': '3bd140ba6a79949a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114227691520', 'san:volume_id': '3bd140ba6a79949a5f6175e7e743eaa935264cba', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.68', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '266240', 'objsetid': '90252', 'name': 'v_350da73c-f3b8-4777-b0d2-56bc054366d1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '266240', 'logicalreferenced': '43855872', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] delete snapshot v_350da73c-f3b8-4777-b0d2-56bc054366d1 of volume s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Geting {'code': 200, 'error': None, 'data': {'available': '114227691520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.manager [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:42:02 user cinder-volume[73393]: INFO cinder.volume.manager [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Deleted volume successfully. Apr 14 04:42:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-da56e572-e7c2-444e-8bbf-a5640b00c071 tempest-VolumeQuotasNegativeTestJSON-618481029 None] Lock "cinder-62ce5c78-2026-46a5-9777-4653e0953328-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:42:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots/v_350da73c-f3b8-4777-b0d2-56bc054366d1 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] snapshot v_350da73c-f3b8-4777-b0d2-56bc054366d1 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:42:03 user cinder-volume[73393]: DEBUG cinder.quota [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['6e7456cf-edac-411c-808e-5085806a0428', 'b3571b78-7bc3-44c9-9edc-48e3c74837dc', 'c65423d5-94c9-453b-9ce4-fc5310800678', 'f22f21d2-0133-4eee-9c65-dd5b56bb9dfb'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:42:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:42:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:42:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'available': '114228019200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.manager [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:42:04 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Deleted volume successfully. Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.coordination [None req-7bab6404-2c44-4497-9821-2e81d1661e8f tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-350da73c-f3b8-4777-b0d2-56bc054366d1-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.coordination [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-98c8ba1d-cb52-46fa-9bf2-35f0db14502f-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.coordination [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-98c8ba1d-cb52-46fa-9bf2-35f0db14502f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] deleating snapshot s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] get volume s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_495f173c-6873-42b6-a0fe-42da67f3aa75@s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448560', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '116089', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10956638787238457961', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bea977250e29f4f8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114228019200', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '88442', 'name': 's_98c8ba1d-cb52-46fa-9bf2-35f0db14502f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] delete snapshot s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f of volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:DELETE=2,cinder:SELECT=58,cinder:INSERT=9,cinder:UPDATE=31 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Flow 'volume_create_manager' (c2c9d9f3-311d-46e5-949f-8d1e2d405aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb13698-7fef-4387-81eb-d07e12a40ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots/s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] snapshot s_98c8ba1d-cb52-46fa-9bf2-35f0db14502f deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=54,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb13698-7fef-4387-81eb-d07e12a40ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1784512557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47970ff1-6022-4984-8604-ac0b3af4412c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad019bafe104d78913288605e8c5888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:42:07Z,use_quota=True,user_id='e95e780755d24760978750e5c146eb98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(365c104b-48bf-4753-b753-63a105e09fb9),volume_type_id=365c104b-48bf-4753-b753-63a105e09fb9)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9771cae-e793-45fb-9290-2da749caf5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9771cae-e793-45fb-9290-2da749caf5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebcd331-ef65-4592-92db-92f68836ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebcd331-ef65-4592-92db-92f68836ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47970ff1-6022-4984-8604-ac0b3af4412c', 'volume_name': 'volume-47970ff1-6022-4984-8604-ac0b3af4412c', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dc1e0b-7a6a-4747-905f-1503c28c69b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dc1e0b-7a6a-4747-905f-1503c28c69b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ff82b7-7153-4737-8cae-6b8f599d33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:42:07 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Volume 47970ff1-6022-4984-8604-ac0b3af4412c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47970ff1-6022-4984-8604-ac0b3af4412c', 'volume_size': 1} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] creating volume v_47970ff1-6022-4984-8604-ac0b3af4412c. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] create volume {'name': 'v_47970ff1-6022-4984-8604-ac0b3af4412c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.quota [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['31da3f5b-8d2f-4cc1-b1fd-a5ee2ed6940d', 'a1fe0f77-993e-4d67-be79-077f49717b76', 'b604899d-ba81-40ce-bf10-849a87c94525', 'e3fb91e4-8b63-43ae-b116-dae9a416d516'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:42:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Delete snapshot completed successfully. Apr 14 04:42:07 user cinder-volume[73393]: DEBUG cinder.coordination [None req-dab6bd56-dba6-4701-a242-65cb4471e973 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-98c8ba1d-cb52-46fa-9bf2-35f0db14502f-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:42:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_47970ff1-6022-4984-8604-ac0b3af4412c', 'is_clone': False, 'name': 'v_47970ff1-6022-4984-8604-ac0b3af4412c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ff82b7-7153-4737-8cae-6b8f599d33f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47970ff1-6022-4984-8604-ac0b3af4412c', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:42:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cea137-6757-4504-abc7-1cccf31d2607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:42:08 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Volume volume-47970ff1-6022-4984-8604-ac0b3af4412c (47970ff1-6022-4984-8604-ac0b3af4412c): created successfully Apr 14 04:42:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cea137-6757-4504-abc7-1cccf31d2607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:42:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Flow 'volume_create_manager' (c2c9d9f3-311d-46e5-949f-8d1e2d405aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:42:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-922d6fe4-fce6-47f8-b3d8-d08a7e94175b tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Created volume successfully. Apr 14 04:42:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:42:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:42:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114228097024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.manager [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:42:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-316c550b-9ada-4d53-a500-aaac33791acb tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Retype volume completed successfully. Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] terminate connection for 495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:42:10 user cinder-volume[73393]: INFO cinder.volume.manager [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Terminate volume connection completed successfully. Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Deleting attachment 5a96efd1-e24e-41bb-aed3-6469de3a07a1. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-754464795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=495f173c-6873-42b6-a0fe-42da67f3aa75,launched_at=2023-04-14T04:34:31Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP tLxSpwaP hEYenvUbs4uCaf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:34:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T04:37:23Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 from target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Acquiring lock "cinder-47970ff1-6022-4984-8604-ac0b3af4412c-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Lock "cinder-47970ff1-6022-4984-8604-ac0b3af4412c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] remove_export for volume: 47970ff1-6022-4984-8604-ac0b3af4412c. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1784512557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47970ff1-6022-4984-8604-ac0b3af4412c,launched_at=2023-04-14T04:42:08Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='0ad019bafe104d78913288605e8c5888',provider_auth='CHAP TIloWBCy NVSfYxTPbGzmHK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:42:07Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:42:11Z,updated_at=2023-04-14T04:42:11Z,use_quota=True,user_id='e95e780755d24760978750e5c146eb98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a69d559-e26c-4130-be6a-79d1f8984489),volume_type_id=3a69d559-e26c-4130-be6a-79d1f8984489) from target:iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] detach volume v_47970ff1-6022-4984-8604-ac0b3af4412c from target iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c/luns/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c/luns/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c/luns/v_47970ff1-6022-4984-8604-ac0b3af4412c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c/luns/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] failed to remove resource iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c because of JDSS resource v_47970ff1-6022-4984-8604-ac0b3af4412c DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] delete target: iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] delete target iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] failed to remove resource iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c because of JDSS resource iqn.2010-10.org.openstack:47970ff1-6022-4984-8604-ac0b3af4412c DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] deleating volume v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] get snapshots for volume v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] get volume v_47970ff1-6022-4984-8604-ac0b3af4412c info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_47970ff1-6022-4984-8604-ac0b3af4412c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448736', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116170', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10681952145892976418', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3222769f9cc9e271', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114228097024', 'san:volume_id': '3222769f9cc9e27117888f1a91f66116b213d714', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89303', 'name': 'v_47970ff1-6022-4984-8604-ac0b3af4412c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] delete volume:v_47970ff1-6022-4984-8604-ac0b3af4412c recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2869c539-e258-45a2-85fb-cf3943c45967 req-b153bf82-aca1-4842-88e2-08b0f9f33d86 tempest-TestVolumeBootPattern-1780160917 None] target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:42:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47970ff1-6022-4984-8604-ac0b3af4412c {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] volume v_47970ff1-6022-4984-8604-ac0b3af4412c deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:42:13 user cinder-volume[73393]: WARNING cinder.quota [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:42:13 user cinder-volume[73393]: WARNING cinder.quota [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:42:13 user cinder-volume[73393]: DEBUG cinder.quota [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Created reservations ['b34a6492-0607-4942-bd5d-ff7246c76463', '449d1377-6326-4cb9-afc8-ec0b0fb007b1', 'f8b27ea5-117c-466d-9af3-2ce106cbe6a1', '26807442-29b3-47ce-b2be-e6fc89d67963'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:42:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:42:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:42:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114228178944', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:42:14 user cinder-volume[73393]: DEBUG cinder.manager [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:42:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Deleted volume successfully. Apr 14 04:42:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-d142a3f3-bf6b-457a-a9af-335e9250a26c tempest-VolumeRetypeWithoutMigrationTest-1307216712 None] Lock "cinder-47970ff1-6022-4984-8604-ac0b3af4412c-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:42:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:42:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:42:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:42:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:42:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:42:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114228166656', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:42:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:42:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:42:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=46,cinder:INSERT=4,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=38,cinder:INSERT=4,cinder:UPDATE=21 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Acquiring lock "cinder-495f173c-6873-42b6-a0fe-42da67f3aa75-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-495f173c-6873-42b6-a0fe-42da67f3aa75-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] remove_export for volume: 495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-754464795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=495f173c-6873-42b6-a0fe-42da67f3aa75,launched_at=2023-04-14T04:34:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693d95858c624feaa60114aa89082186',provider_auth='CHAP tLxSpwaP hEYenvUbs4uCaf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:34:28Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:43:00Z,updated_at=2023-04-14T04:43:00Z,use_quota=True,user_id='bcf79de7da27495dbfd14c556b5b54c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] detach volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 from target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75/luns/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 because of JDSS resource v_495f173c-6873-42b6-a0fe-42da67f3aa75 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] delete target: iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] delete target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] failed to remove resource iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 because of JDSS resource iqn.2010-10.org.openstack:495f173c-6873-42b6-a0fe-42da67f3aa75 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] deleating volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] get snapshots for volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] get volume v_495f173c-6873-42b6-a0fe-42da67f3aa75 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448278', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '115964', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5680990764993550689', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10149888', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '12d4bb3c395f8b29', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114228166656', 'san:volume_id': '12d4bb3c395f8b2985ff22de87469793bbd1ce7d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10149888', 'objsetid': '89042', 'name': 'v_495f173c-6873-42b6-a0fe-42da67f3aa75', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10149888', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] delete snapshot v_495f173c-6873-42b6-a0fe-42da67f3aa75 of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_495f173c-6873-42b6-a0fe-42da67f3aa75 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] snapshot v_495f173c-6873-42b6-a0fe-42da67f3aa75 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:43:02 user cinder-volume[73393]: DEBUG cinder.quota [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Created reservations ['54ce2352-f7dd-45f2-ac96-845ff3af8e00', '1727918c-8723-406b-8320-64cecf347f60', 'ef1dbda4-466f-4b6f-ade0-bacccf61727d', '73de87f5-24d9-4401-8df3-1fadff2dbd17'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:43:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:43:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:43:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238402560', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:43:03 user cinder-volume[73393]: DEBUG cinder.manager [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:43:03 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Deleted volume successfully. Apr 14 04:43:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9ab863ad-51bd-4cd1-9150-bf43d55eb833 tempest-TestVolumeBootPattern-1780160917 None] Lock "cinder-495f173c-6873-42b6-a0fe-42da67f3aa75-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:43:07 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Flow 'volume_create_manager' (0ac19b5d-d304-4893-9784-2a41fc845438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6936948-2782-43b4-8b10-1a119c7e75d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6936948-2782-43b4-8b10-1a119c7e75d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835240395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:43:08Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b70346b-c9dd-46ec-ae4e-70ca4a09f88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b70346b-c9dd-46ec-ae4e-70ca4a09f88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a4bae4-4807-48d0-8270-280107bde5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a4bae4-4807-48d0-8270-280107bde5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'volume_name': 'volume-5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c21e5f8-36ea-47b7-ac89-2e69e7b63ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c21e5f8-36ea-47b7-ac89-2e69e7b63ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294cf241-6892-4a4e-a259-18722c10f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:08 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'volume_size': 1} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] creating volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] create volume {'name': 'v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'is_clone': False, 'name': 'v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294cf241-6892-4a4e-a259-18722c10f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865b6670-fc0c-4a3a-aa46-a28946360f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:08 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Volume volume-5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 (5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7): created successfully Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865b6670-fc0c-4a3a-aa46-a28946360f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Flow 'volume_create_manager' (0ac19b5d-d304-4893-9784-2a41fc845438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:43:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e9ce7f74-76a7-4ea2-ac8f-bf3657e548b4 tempest-AttachVolumeNegativeTest-1197484356 None] Created volume successfully. Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] create export for volume: 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] ensure volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] check if targe iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] create target and attach volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] create target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] atach volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 to target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:43:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6639376132353630', 'lun': 0, 'mode': 'wt', 'name': 'v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'prod_id': 'Storage', 'scsi_id': 'f97a2560685273af'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] add credentails to target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:43:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'name': 'ULBNyXqg'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] initialize_connection for 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:43:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ULBNyXqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '6eb9607f-5b87-4c3f-bc69-807b73c894e7'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:43:14 user cinder-volume[73393]: INFO cinder.volume.manager [req-4c817f47-2d17-4cfa-beb0-9f6173f158cf req-02a44b81-09eb-4494-8211-a2e8f1096293 tempest-AttachVolumeNegativeTest-1197484356 None] attachment_update completed successfully. Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] terminate connection for 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:43:19 user cinder-volume[73393]: INFO cinder.volume.manager [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Terminate volume connection completed successfully. Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Deleting attachment 6eb9607f-5b87-4c3f-bc69-807b73c894e7. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] remove_export for volume: 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835240395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7,launched_at=2023-04-14T04:43:09Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth='CHAP ULBNyXqg vgd64VslBOtuoX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:43:08Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:43:18Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] detach volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 from target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] delete target: iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] delete target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf req-6fd0e167-616f-437f-ac72-61da5cb39ca5 tempest-AttachVolumeNegativeTest-1197484356 None] target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:43:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:43:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:43:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:43:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238332928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:43:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:43:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=32,cinder:INSERT=1,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Flow 'volume_create_manager' (15e73ccf-bbb5-44a0-9585-6934b29211f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb381d4-9899-41b5-b7a3-eeb075eaf242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb381d4-9899-41b5-b7a3-eeb075eaf242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2115435221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a8e6a311-8ecf-435d-a4bd-23726576f9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10c8cf348e04e44afbaae93a4b60e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:43:52Z,use_quota=True,user_id='67d6c699fc524554a6f4983af91d58fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4fd4d-32aa-4236-9ec2-dba3c81a3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4fd4d-32aa-4236-9ec2-dba3c81a3913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b37b51-2a9c-4331-a5dc-d2ac6825cf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b37b51-2a9c-4331-a5dc-d2ac6825cf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'volume_name': 'volume-a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa2780c-c185-4c69-b143-3cea90b378db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa2780c-c185-4c69-b143-3cea90b378db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8632f4-a04b-4750-8b61-c07cbd9e931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:52 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Volume a8e6a311-8ecf-435d-a4bd-23726576f9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'volume_size': 1} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] creating volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] create volume {'name': 'v_a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:43:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:43:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'is_clone': False, 'name': 'v_a8e6a311-8ecf-435d-a4bd-23726576f9bb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:43:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8632f4-a04b-4750-8b61-c07cbd9e931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb63dbe1-0940-4ee5-a10f-3cfaddded3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:43:53 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Volume volume-a8e6a311-8ecf-435d-a4bd-23726576f9bb (a8e6a311-8ecf-435d-a4bd-23726576f9bb): created successfully Apr 14 04:43:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb63dbe1-0940-4ee5-a10f-3cfaddded3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:43:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Flow 'volume_create_manager' (15e73ccf-bbb5-44a0-9585-6934b29211f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:43:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c2543fbd-6d88-4d6b-9774-6908cd451641 tempest-AttachVolumeShelveTestJSON-2141578557 None] Created volume successfully. Apr 14 04:43:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (6a5a2b3e-0cd6-4e8d-9ee3-0355a1518c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d85573-7df9-43ef-8b40-2c4e67e53544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d85573-7df9-43ef-8b40-2c4e67e53544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350447366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=df2f94d6-6a17-432d-be3f-791be5255564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:44:12Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00889b1-cc1b-4d24-aadc-f82b6ad04f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00889b1-cc1b-4d24-aadc-f82b6ad04f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf43ac7-d2f2-4b75-8b1d-033954f3fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf43ac7-d2f2-4b75-8b1d-033954f3fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2f94d6-6a17-432d-be3f-791be5255564', 'volume_name': 'volume-df2f94d6-6a17-432d-be3f-791be5255564', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c498b2-8352-47ab-9ac2-2397a7873507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c498b2-8352-47ab-9ac2-2397a7873507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f2dea4-d180-4d20-bdcc-aaac1bcd61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:44:11 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Volume df2f94d6-6a17-432d-be3f-791be5255564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2f94d6-6a17-432d-be3f-791be5255564', 'volume_size': 1} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] creating volume v_df2f94d6-6a17-432d-be3f-791be5255564. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] create volume {'name': 'v_df2f94d6-6a17-432d-be3f-791be5255564', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_df2f94d6-6a17-432d-be3f-791be5255564', 'is_clone': False, 'name': 'v_df2f94d6-6a17-432d-be3f-791be5255564'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f2dea4-d180-4d20-bdcc-aaac1bcd61ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2f94d6-6a17-432d-be3f-791be5255564', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a357ba40-27f6-4178-832e-d5f5a78604d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:44:12 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Volume volume-df2f94d6-6a17-432d-be3f-791be5255564 (df2f94d6-6a17-432d-be3f-791be5255564): created successfully Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a357ba40-27f6-4178-832e-d5f5a78604d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (6a5a2b3e-0cd6-4e8d-9ee3-0355a1518c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:44:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d98d17cc-3947-4404-9cca-fa0aac31f36c tempest-VolumesActionsTest-318780639 None] Created volume successfully. Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-227d65fd-cf14-4d1c-a5b4-e25e289e40d4 tempest-VolumesActionsTest-318780639 None] Acquiring lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564" by "attach_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-227d65fd-cf14-4d1c-a5b4-e25e289e40d4 tempest-VolumesActionsTest-318780639 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564" acquired by "attach_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:44:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-227d65fd-cf14-4d1c-a5b4-e25e289e40d4 tempest-VolumesActionsTest-318780639 None] Attaching volume df2f94d6-6a17-432d-be3f-791be5255564 to instance d3f489a4-972c-4c96-9235-596c23910a9b at mountpoint /dev/vdb on host None. Apr 14 04:44:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-227d65fd-cf14-4d1c-a5b4-e25e289e40d4 tempest-VolumesActionsTest-318780639 None] Attach volume completed successfully. Apr 14 04:44:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-227d65fd-cf14-4d1c-a5b4-e25e289e40d4 tempest-VolumesActionsTest-318780639 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564" released by "attach_volume" :: held 0.070s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] terminate connection for df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:44:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Terminate volume connection completed successfully. Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Acquiring lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-detach_volume" by "detach_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:44:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Detaching volume df2f94d6-6a17-432d-be3f-791be5255564 from instance d3f489a4-972c-4c96-9235-596c23910a9b. Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] remove_export for volume: df2f94d6-6a17-432d-be3f-791be5255564. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] detach volume:Volume(_name_id=None,admin_metadata={attached_mode='rw',readonly='False'},attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350447366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=df2f94d6-6a17-432d-be3f-791be5255564,launched_at=2023-04-14T04:44:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth='CHAP YSLiusge hUYacqe5GXkDwT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:44:12Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='error',terminated_at=None,updated_at=2023-04-14T04:44:13Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] detach volume v_df2f94d6-6a17-432d-be3f-791be5255564 from target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 because of JDSS resource v_df2f94d6-6a17-432d-be3f-791be5255564 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] delete target: iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] delete target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 because of JDSS resource iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:44:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Detach volume completed successfully. Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e9e866bc-7196-4e95-b9b9-9d71b1bc5f39 tempest-VolumesActionsTest-2114824586 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e92faa99-243b-4513-a1d1-5b294ac3789d tempest-VolumesActionsTest-318780639 None] Acquiring lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-detach_volume" by "detach_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e92faa99-243b-4513-a1d1-5b294ac3789d tempest-VolumesActionsTest-318780639 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:44:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e92faa99-243b-4513-a1d1-5b294ac3789d tempest-VolumesActionsTest-318780639 None] Volume detach called, but volume not attached. Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-e92faa99-243b-4513-a1d1-5b294ac3789d tempest-VolumesActionsTest-318780639 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Acquiring lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] remove_export for volume: df2f94d6-6a17-432d-be3f-791be5255564. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350447366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=df2f94d6-6a17-432d-be3f-791be5255564,launched_at=2023-04-14T04:44:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth='CHAP YSLiusge hUYacqe5GXkDwT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:44:12Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:44:14Z,updated_at=2023-04-14T04:44:14Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] detach volume v_df2f94d6-6a17-432d-be3f-791be5255564 from target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564/luns/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] failed to remove resource iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 because of JDSS resource v_df2f94d6-6a17-432d-be3f-791be5255564 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] delete target: iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] delete target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] failed to remove resource iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 because of JDSS resource iqn.2010-10.org.openstack:df2f94d6-6a17-432d-be3f-791be5255564 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] deleating volume v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] get snapshots for volume v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] get volume v_df2f94d6-6a17-432d-be3f-791be5255564 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_df2f94d6-6a17-432d-be3f-791be5255564', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448861', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116214', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8079929602477297126', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fa895123f21be802', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238169088', 'san:volume_id': 'fa895123f21be8025d7eec26956291245981daad', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89823', 'name': 'v_df2f94d6-6a17-432d-be3f-791be5255564', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] delete volume:v_df2f94d6-6a17-432d-be3f-791be5255564 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_df2f94d6-6a17-432d-be3f-791be5255564 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] volume v_df2f94d6-6a17-432d-be3f-791be5255564 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:44:16 user cinder-volume[73393]: DEBUG cinder.quota [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Created reservations ['d1569228-963f-4fb6-be79-2c3d8129c4af', '03271aa7-4f36-4f2e-9fbf-50726aaba066', '65cc02db-65b0-4206-bc61-28fa4f6b6b10', '409a87e6-d755-4187-a895-cb80819ffa95'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:44:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:44:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:44:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238251008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:44:17 user cinder-volume[73393]: DEBUG cinder.manager [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:44:17 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Deleted volume successfully. Apr 14 04:44:17 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2da80a41-c096-489f-85aa-c37a1c917697 tempest-VolumesActionsTest-318780639 None] Lock "cinder-df2f94d6-6a17-432d-be3f-791be5255564-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:44:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=40,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:44:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:44:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:44:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:44:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:44:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238275584', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:44:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:44:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:44:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=35,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (36d30de5-c737-4a5f-b49f-a04f7035b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a84ac10-41c0-4db7-a78e-c67ef0960050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a84ac10-41c0-4db7-a78e-c67ef0960050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519100297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=85ccd53f-b201-442f-880c-902617932e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:45:08Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddc01e1-1404-428a-b537-ec1b28da4955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddc01e1-1404-428a-b537-ec1b28da4955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13e829a-b78c-4221-81ec-3e83fb7c179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13e829a-b78c-4221-81ec-3e83fb7c179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ccd53f-b201-442f-880c-902617932e0e', 'volume_name': 'volume-85ccd53f-b201-442f-880c-902617932e0e', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d4108d-5662-4b68-b204-5dafee4a2e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d4108d-5662-4b68-b204-5dafee4a2e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fca6a78-0f1c-49fe-ad32-09f7196d5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:07 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Volume 85ccd53f-b201-442f-880c-902617932e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ccd53f-b201-442f-880c-902617932e0e', 'volume_size': 1} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] creating volume v_85ccd53f-b201-442f-880c-902617932e0e. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] create volume {'name': 'v_85ccd53f-b201-442f-880c-902617932e0e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_85ccd53f-b201-442f-880c-902617932e0e', 'is_clone': False, 'name': 'v_85ccd53f-b201-442f-880c-902617932e0e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fca6a78-0f1c-49fe-ad32-09f7196d5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ccd53f-b201-442f-880c-902617932e0e', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e28ef1-6b6c-4c47-b7b3-199c7978164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:08 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Volume volume-85ccd53f-b201-442f-880c-902617932e0e (85ccd53f-b201-442f-880c-902617932e0e): created successfully Apr 14 04:45:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e28ef1-6b6c-4c47-b7b3-199c7978164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (36d30de5-c737-4a5f-b49f-a04f7035b81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-cca1afda-4ad0-45f9-92c9-06af1ae7afd5 tempest-VolumesActionsTest-318780639 None] Created volume successfully. Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Acquiring lock "cinder-85ccd53f-b201-442f-880c-902617932e0e-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Lock "cinder-85ccd53f-b201-442f-880c-902617932e0e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] remove_export for volume: 85ccd53f-b201-442f-880c-902617932e0e. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519100297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=85ccd53f-b201-442f-880c-902617932e0e,launched_at=2023-04-14T04:45:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth='CHAP ucqahvOz LkujzGxE3aMRpH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:08Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:45:09Z,updated_at=2023-04-14T04:45:09Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] detach volume v_85ccd53f-b201-442f-880c-902617932e0e from target iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e/luns/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e/luns/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e/luns/v_85ccd53f-b201-442f-880c-902617932e0e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e/luns/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e because of JDSS resource v_85ccd53f-b201-442f-880c-902617932e0e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] delete target: iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] delete target iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e because of JDSS resource iqn.2010-10.org.openstack:85ccd53f-b201-442f-880c-902617932e0e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] deleating volume v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] get snapshots for volume v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] get volume v_85ccd53f-b201-442f-880c-902617932e0e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_85ccd53f-b201-442f-880c-902617932e0e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448917', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116229', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11527810497117758350', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1e2c89db287bf4da', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238181376', 'san:volume_id': '1e2c89db287bf4da02d2e409a89409da43f9fd73', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90373', 'name': 'v_85ccd53f-b201-442f-880c-902617932e0e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] delete volume:v_85ccd53f-b201-442f-880c-902617932e0e recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85ccd53f-b201-442f-880c-902617932e0e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] volume v_85ccd53f-b201-442f-880c-902617932e0e deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:45:11 user cinder-volume[73393]: DEBUG cinder.quota [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Created reservations ['88a78ad3-885e-42e4-bd69-1563dfb9c7d1', '3a702bcd-7812-40b5-af2e-26fbd487a825', '8bea783a-f9c6-4b71-a5f9-a1c5a1c784d6', '4baba9fb-be45-4836-a231-30c0938a2015'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238263296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.manager [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Deleted volume successfully. Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0a6f9f5d-d976-4904-b877-78beef223b4e tempest-VolumesActionsTest-2114824586 None] Lock "cinder-85ccd53f-b201-442f-880c-902617932e0e-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (9faf3412-6012-442e-ad89-f5e4c3d9c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79c9c92-c5e6-4e2c-9aec-e257bb7012c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79c9c92-c5e6-4e2c-9aec-e257bb7012c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055221468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a3491af4-64b3-4e8e-939b-332f8a9508ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:45:13Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753fbcc8-9984-4f07-8ce9-ffae169e986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753fbcc8-9984-4f07-8ce9-ffae169e986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6cc24d-5c19-46b8-8163-2d55ed095f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6cc24d-5c19-46b8-8163-2d55ed095f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3491af4-64b3-4e8e-939b-332f8a9508ed', 'volume_name': 'volume-a3491af4-64b3-4e8e-939b-332f8a9508ed', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea6ee85-fe9d-483e-a0f5-56468deec2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea6ee85-fe9d-483e-a0f5-56468deec2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1aced52-a098-4473-b617-ceb4c417dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:12 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Volume a3491af4-64b3-4e8e-939b-332f8a9508ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3491af4-64b3-4e8e-939b-332f8a9508ed', 'volume_size': 1} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] creating volume v_a3491af4-64b3-4e8e-939b-332f8a9508ed. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] create volume {'name': 'v_a3491af4-64b3-4e8e-939b-332f8a9508ed', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a3491af4-64b3-4e8e-939b-332f8a9508ed', 'is_clone': False, 'name': 'v_a3491af4-64b3-4e8e-939b-332f8a9508ed'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1aced52-a098-4473-b617-ceb4c417dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3491af4-64b3-4e8e-939b-332f8a9508ed', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b41579-63c6-4ec2-b735-d83584d371d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Volume volume-a3491af4-64b3-4e8e-939b-332f8a9508ed (a3491af4-64b3-4e8e-939b-332f8a9508ed): created successfully Apr 14 04:45:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b41579-63c6-4ec2-b735-d83584d371d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (9faf3412-6012-442e-ad89-f5e4c3d9c61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:13 user cinder-volume[73393]: INFO cinder.volume.manager [None req-33293874-db63-4995-b89c-4413b92339f0 tempest-VolumesActionsTest-318780639 None] Created volume successfully. Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Acquiring lock "cinder-a3491af4-64b3-4e8e-939b-332f8a9508ed-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Lock "cinder-a3491af4-64b3-4e8e-939b-332f8a9508ed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] remove_export for volume: a3491af4-64b3-4e8e-939b-332f8a9508ed. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055221468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a3491af4-64b3-4e8e-939b-332f8a9508ed,launched_at=2023-04-14T04:45:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth='CHAP KiWszICv MYiQbEl4nL93BW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:13Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:45:15Z,updated_at=2023-04-14T04:45:15Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] detach volume v_a3491af4-64b3-4e8e-939b-332f8a9508ed from target iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed/luns/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed/luns/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed/luns/v_a3491af4-64b3-4e8e-939b-332f8a9508ed'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed/luns/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed because of JDSS resource v_a3491af4-64b3-4e8e-939b-332f8a9508ed DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] delete target: iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] delete target iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed because of JDSS resource iqn.2010-10.org.openstack:a3491af4-64b3-4e8e-939b-332f8a9508ed DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] deleating volume v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] get snapshots for volume v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] get volume v_a3491af4-64b3-4e8e-939b-332f8a9508ed info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a3491af4-64b3-4e8e-939b-332f8a9508ed', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448922', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116234', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17428948158552931749', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '067d235dbcee1ff8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238169088', 'san:volume_id': '067d235dbcee1ff87e7a645f5a87d61526e3f3c4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90274', 'name': 'v_a3491af4-64b3-4e8e-939b-332f8a9508ed', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] delete volume:v_a3491af4-64b3-4e8e-939b-332f8a9508ed recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3491af4-64b3-4e8e-939b-332f8a9508ed {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] volume v_a3491af4-64b3-4e8e-939b-332f8a9508ed deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:45:17 user cinder-volume[73393]: DEBUG cinder.quota [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Created reservations ['ec1cbd4e-2256-4624-8e11-06c910008158', 'b0990f68-7025-423c-8302-f96b8948fbf7', '1176d942-344a-4236-82ef-fb1a9c6e12d0', 'c510cc0f-7f76-41d4-a6e0-1bf61aef22e9'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238238720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.manager [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Deleted volume successfully. Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.coordination [None req-84db132c-e20c-4e8f-83bd-9c2863853a6d tempest-VolumesActionsTest-2114824586 None] Lock "cinder-a3491af4-64b3-4e8e-939b-332f8a9508ed-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (d3a6c78b-fd61-48a2-9bb6-a3ffcd1bfbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cdd1c4-c384-43b2-b259-5248d0b5c37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cdd1c4-c384-43b2-b259-5248d0b5c37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343267793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5068c43d-49b4-4c26-8807-e004700e8778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:45:19Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a423c3c-c7c4-49e3-baa3-78896efa756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a423c3c-c7c4-49e3-baa3-78896efa756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f807cd0a-d6be-4327-971e-d592a8bd8877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f807cd0a-d6be-4327-971e-d592a8bd8877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5068c43d-49b4-4c26-8807-e004700e8778', 'volume_name': 'volume-5068c43d-49b4-4c26-8807-e004700e8778', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae94689-d334-4df7-b504-a9a3870c6266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae94689-d334-4df7-b504-a9a3870c6266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660e5c69-e763-4a07-afa2-0506063608cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:18 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Volume 5068c43d-49b4-4c26-8807-e004700e8778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5068c43d-49b4-4c26-8807-e004700e8778', 'volume_size': 1} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] creating volume v_5068c43d-49b4-4c26-8807-e004700e8778. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] create volume {'name': 'v_5068c43d-49b4-4c26-8807-e004700e8778', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5068c43d-49b4-4c26-8807-e004700e8778', 'is_clone': False, 'name': 'v_5068c43d-49b4-4c26-8807-e004700e8778'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660e5c69-e763-4a07-afa2-0506063608cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5068c43d-49b4-4c26-8807-e004700e8778', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1703a-4022-4aa8-8f62-4a85a8c4d5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:19 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Volume volume-5068c43d-49b4-4c26-8807-e004700e8778 (5068c43d-49b4-4c26-8807-e004700e8778): created successfully Apr 14 04:45:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1703a-4022-4aa8-8f62-4a85a8c4d5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (d3a6c78b-fd61-48a2-9bb6-a3ffcd1bfbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:19 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6908595a-e0b2-477f-b041-ee05ccba4c12 tempest-VolumesActionsTest-318780639 None] Created volume successfully. Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Acquiring lock "cinder-5068c43d-49b4-4c26-8807-e004700e8778-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Lock "cinder-5068c43d-49b4-4c26-8807-e004700e8778-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] remove_export for volume: 5068c43d-49b4-4c26-8807-e004700e8778. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343267793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5068c43d-49b4-4c26-8807-e004700e8778,launched_at=2023-04-14T04:45:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth='CHAP hiFxCtZJ BpW6oKPO2bryJd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:19Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:45:21Z,updated_at=2023-04-14T04:45:21Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] detach volume v_5068c43d-49b4-4c26-8807-e004700e8778 from target iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778/luns/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778/luns/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778/luns/v_5068c43d-49b4-4c26-8807-e004700e8778'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778/luns/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 because of JDSS resource v_5068c43d-49b4-4c26-8807-e004700e8778 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] delete target: iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] delete target iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 because of JDSS resource iqn.2010-10.org.openstack:5068c43d-49b4-4c26-8807-e004700e8778 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] deleating volume v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] get snapshots for volume v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] get volume v_5068c43d-49b4-4c26-8807-e004700e8778 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5068c43d-49b4-4c26-8807-e004700e8778', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448927', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116239', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17850762904744543478', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '961251d997281476', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238181376', 'san:volume_id': '961251d997281476a19b4b66829be340ee1a3f5a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90383', 'name': 'v_5068c43d-49b4-4c26-8807-e004700e8778', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] delete volume:v_5068c43d-49b4-4c26-8807-e004700e8778 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5068c43d-49b4-4c26-8807-e004700e8778 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] volume v_5068c43d-49b4-4c26-8807-e004700e8778 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Created reservations ['15e0d020-db4d-4e15-93c1-7e11ce7e6c7a', '1e1f4324-7827-4638-a4f6-372ef5e34dfa', '55a33b04-6af5-44c5-a06f-11c77743c8c5', '4ffd8988-6f80-49aa-b37e-6ba8f3fa02d0'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238263296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:23 user cinder-volume[73393]: DEBUG cinder.manager [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Deleted volume successfully. Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ea06080d-c6cc-4387-b4bf-0cec4a759cbb tempest-VolumesActionsTest-2114824586 None] Lock "cinder-5068c43d-49b4-4c26-8807-e004700e8778-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (9d624373-d2df-4ea9-8bf7-adb8762ee7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ceaefa-9ca9-49dd-b757-5079daedabd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ceaefa-9ca9-49dd-b757-5079daedabd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-502365882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b1ce0bcb-55f4-4dc0-a82f-052520074986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:45:24Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c2dca-f4e2-444e-b1c2-8377f92ae074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c2dca-f4e2-444e-b1c2-8377f92ae074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a8d578-2a85-4ba4-8717-0b5451661cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a8d578-2a85-4ba4-8717-0b5451661cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ce0bcb-55f4-4dc0-a82f-052520074986', 'volume_name': 'volume-b1ce0bcb-55f4-4dc0-a82f-052520074986', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6572a574-aef4-47c0-b3e2-0a8b90dd3487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6572a574-aef4-47c0-b3e2-0a8b90dd3487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b95809-9047-43ac-ac13-6ffcf5bf70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:24 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Volume b1ce0bcb-55f4-4dc0-a82f-052520074986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ce0bcb-55f4-4dc0-a82f-052520074986', 'volume_size': 1} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] creating volume v_b1ce0bcb-55f4-4dc0-a82f-052520074986. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] create volume {'name': 'v_b1ce0bcb-55f4-4dc0-a82f-052520074986', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238263296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b1ce0bcb-55f4-4dc0-a82f-052520074986', 'is_clone': False, 'name': 'v_b1ce0bcb-55f4-4dc0-a82f-052520074986'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b95809-9047-43ac-ac13-6ffcf5bf70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ce0bcb-55f4-4dc0-a82f-052520074986', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7282270b-cfab-4a05-b09f-ca64c29e5272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=52,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:25 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Volume volume-b1ce0bcb-55f4-4dc0-a82f-052520074986 (b1ce0bcb-55f4-4dc0-a82f-052520074986): created successfully Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7282270b-cfab-4a05-b09f-ca64c29e5272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (9d624373-d2df-4ea9-8bf7-adb8762ee7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b5e4ac85-f298-412c-984e-72fa189e920f tempest-VolumesActionsTest-318780639 None] Created volume successfully. Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Acquiring lock "cinder-b1ce0bcb-55f4-4dc0-a82f-052520074986-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Lock "cinder-b1ce0bcb-55f4-4dc0-a82f-052520074986-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] remove_export for volume: b1ce0bcb-55f4-4dc0-a82f-052520074986. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-502365882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b1ce0bcb-55f4-4dc0-a82f-052520074986,launched_at=2023-04-14T04:45:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth='CHAP BTbOpklZ FQGDeHZSo6bd3E',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:24Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:45:26Z,updated_at=2023-04-14T04:45:26Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] detach volume v_b1ce0bcb-55f4-4dc0-a82f-052520074986 from target iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986/luns/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986/luns/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986/luns/v_b1ce0bcb-55f4-4dc0-a82f-052520074986'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986/luns/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 because of JDSS resource v_b1ce0bcb-55f4-4dc0-a82f-052520074986 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] delete target: iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] delete target iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] failed to remove resource iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 because of JDSS resource iqn.2010-10.org.openstack:b1ce0bcb-55f4-4dc0-a82f-052520074986 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] deleating volume v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] get snapshots for volume v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] get volume v_b1ce0bcb-55f4-4dc0-a82f-052520074986 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b1ce0bcb-55f4-4dc0-a82f-052520074986', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448933', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116244', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17408525210688856731', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b6b005e1bb8d351d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238156800', 'san:volume_id': 'b6b005e1bb8d351db413e22e06cc8360c95ab952', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89550', 'name': 'v_b1ce0bcb-55f4-4dc0-a82f-052520074986', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] delete volume:v_b1ce0bcb-55f4-4dc0-a82f-052520074986 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1ce0bcb-55f4-4dc0-a82f-052520074986 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] volume v_b1ce0bcb-55f4-4dc0-a82f-052520074986 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.quota [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Created reservations ['d88df85f-c821-41e0-8415-d82fe5e42be0', '7621c971-82e4-41b1-b887-56509c533ceb', '061b4a79-1ff5-4912-abf6-5ecb6743f9b4', '0647c91f-3ef4-4e55-b1e5-8a232aed2f77'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:DELETE=2,cinder:INSERT=7,cinder:UPDATE=34 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238238720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.manager [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Deleted volume successfully. Apr 14 04:45:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-431c6ca4-ff43-44e9-acb8-cd4f35c816e9 tempest-VolumesActionsTest-2114824586 None] Lock "cinder-b1ce0bcb-55f4-4dc0-a82f-052520074986-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (618d380f-55cf-410c-92fc-55fed811b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f50c6f-3b34-48c6-b632-1f851f0a33ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f50c6f-3b34-48c6-b632-1f851f0a33ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-987725708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1410f3a3-0ec8-4f8d-994e-d3100bd1c440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:45:29Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c400b838-26af-442a-90d4-2893cc77394b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c400b838-26af-442a-90d4-2893cc77394b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66df3cb0-1143-4fc3-9b2e-25ac8d0340e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66df3cb0-1143-4fc3-9b2e-25ac8d0340e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'volume_name': 'volume-1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad11d0-599c-4fa5-93ae-497d3abdfbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad11d0-599c-4fa5-93ae-497d3abdfbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9543e85f-c8ed-4251-90c6-c4a726312ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:29 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Volume 1410f3a3-0ec8-4f8d-994e-d3100bd1c440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'volume_size': 1} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] creating volume v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] create volume {'name': 'v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'is_clone': False, 'name': 'v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9543e85f-c8ed-4251-90c6-c4a726312ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9e7c51-f34d-4f36-b216-d088594ced5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:30 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Volume volume-1410f3a3-0ec8-4f8d-994e-d3100bd1c440 (1410f3a3-0ec8-4f8d-994e-d3100bd1c440): created successfully Apr 14 04:45:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9e7c51-f34d-4f36-b216-d088594ced5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Flow 'volume_create_manager' (618d380f-55cf-410c-92fc-55fed811b413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1a2f0c6f-f893-412c-abbf-bdb9a3888140 tempest-VolumesActionsTest-318780639 None] Created volume successfully. Apr 14 04:45:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Acquiring lock "cinder-1410f3a3-0ec8-4f8d-994e-d3100bd1c440-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.coordination [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Lock "cinder-1410f3a3-0ec8-4f8d-994e-d3100bd1c440-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] remove_export for volume: 1410f3a3-0ec8-4f8d-994e-d3100bd1c440. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-987725708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1410f3a3-0ec8-4f8d-994e-d3100bd1c440,launched_at=2023-04-14T04:45:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb95f5c644e4da8b9ab39f07ea79955',provider_auth='CHAP QmYPcHkb mzkrvA6pK08xLf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:29Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:45:32Z,updated_at=2023-04-14T04:45:32Z,use_quota=True,user_id='e8c753ed91f748b8842b022e65b1cfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] detach volume v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 from target iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440/luns/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440/luns/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440/luns/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440/luns/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] failed to remove resource iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 because of JDSS resource v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] delete target: iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] delete target iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] failed to remove resource iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 because of JDSS resource iqn.2010-10.org.openstack:1410f3a3-0ec8-4f8d-994e-d3100bd1c440 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] deleating volume v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] get snapshots for volume v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] get volume v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448938', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116249', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3122545644576635865', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '48c2af213d3d9093', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238132224', 'san:volume_id': '48c2af213d3d90931445e16b6c6c4f6466e0ef77', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89901', 'name': 'v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] delete volume:v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:32 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] volume v_1410f3a3-0ec8-4f8d-994e-d3100bd1c440 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:45:34 user cinder-volume[73393]: DEBUG cinder.quota [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Created reservations ['7c4448f9-959d-47f7-bcfe-41348dfa4f89', '4b886e57-1136-472a-9dfc-dd88100fcc05', '414fecb4-60ab-4b16-a1a3-bcdf6fc71729', '177ab985-a940-4923-aed2-71fd1e23a636'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238214144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:35 user cinder-volume[73393]: DEBUG cinder.manager [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:35 user cinder-volume[73393]: INFO cinder.volume.manager [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Deleted volume successfully. Apr 14 04:45:35 user cinder-volume[73393]: DEBUG cinder.coordination [None req-be63de86-8002-4b96-8257-268b4d201633 tempest-VolumesActionsTest-318780639 None] Lock "cinder-1410f3a3-0ec8-4f8d-994e-d3100bd1c440-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Flow 'volume_create_manager' (b6318a76-ac2e-49a6-adfd-72693f51b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccfdfe2-b50e-452b-a3c9-48ca4311d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccfdfe2-b50e-452b-a3c9-48ca4311d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2007719191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4fe65255-f561-4684-bba2-804bab391fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb74f89b0d8e4066a4709446ad4864ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:45:39Z,use_quota=True,user_id='e9b332e7b8d341b1b22968f4a11bbd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00be6b35-2c24-46c5-947a-95e3a00bdceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00be6b35-2c24-46c5-947a-95e3a00bdceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f2b608-62e0-4c2d-9615-6f022e556889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f2b608-62e0-4c2d-9615-6f022e556889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4fe65255-f561-4684-bba2-804bab391fd7', 'volume_name': 'volume-4fe65255-f561-4684-bba2-804bab391fd7', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32680060-87a3-4b33-a9f0-a815892c43c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32680060-87a3-4b33-a9f0-a815892c43c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb94369-5d9f-4344-b590-29f6f95b3930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:39 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Volume 4fe65255-f561-4684-bba2-804bab391fd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4fe65255-f561-4684-bba2-804bab391fd7', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Cloning 4fe65255-f561-4684-bba2-804bab391fd7 from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 45, 39, 413361)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.coordination [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 45, 39, 424615)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] create snapshot v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_4fe65255-f561-4684-bba2-804bab391fd7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] create volume v_4fe65255-f561-4684-bba2-804bab391fd7 from snapshot v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:45:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_4fe65255-f561-4684-bba2-804bab391fd7', 'is_clone': True, 'full_name': 'Pool-0/v_4fe65255-f561-4684-bba2-804bab391fd7', 'name': 'v_4fe65255-f561-4684-bba2-804bab391fd7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] get volume v_4fe65255-f561-4684-bba2-804bab391fd7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_4fe65255-f561-4684-bba2-804bab391fd7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4fe65255-f561-4684-bba2-804bab391fd7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448949', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '116257', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17131891434258732201', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4d414b15a40eb6a3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238189568', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89569', 'name': 'v_4fe65255-f561-4684-bba2-804bab391fd7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Marking volume 4fe65255-f561-4684-bba2-804bab391fd7 as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 4fe65255-f561-4684-bba2-804bab391fd7. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Creating volume glance metadata for volume 4fe65255-f561-4684-bba2-804bab391fd7 backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb94369-5d9f-4344-b590-29f6f95b3930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe65255-f561-4684-bba2-804bab391fd7', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5f0810-c820-495d-bf9e-5aeb92f9227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Volume volume-4fe65255-f561-4684-bba2-804bab391fd7 (4fe65255-f561-4684-bba2-804bab391fd7): created successfully Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5f0810-c820-495d-bf9e-5aeb92f9227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Flow 'volume_create_manager' (b6318a76-ac2e-49a6-adfd-72693f51b721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:41 user cinder-volume[73393]: INFO cinder.volume.manager [None req-a6423877-a6da-4ac6-974d-e463987ae829 tempest-VolumesImageMetadata-992309861 None] Created volume successfully. Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.coordination [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Acquiring lock "cinder-4fe65255-f561-4684-bba2-804bab391fd7-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.coordination [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Lock "cinder-4fe65255-f561-4684-bba2-804bab391fd7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] remove_export for volume: 4fe65255-f561-4684-bba2-804bab391fd7. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2007719191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4fe65255-f561-4684-bba2-804bab391fd7,launched_at=2023-04-14T04:45:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb74f89b0d8e4066a4709446ad4864ba',provider_auth='CHAP bkAoFPRW fFLeGbvgRIoc8Q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:39Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:45:43Z,updated_at=2023-04-14T04:45:43Z,use_quota=True,user_id='e9b332e7b8d341b1b22968f4a11bbd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] detach volume v_4fe65255-f561-4684-bba2-804bab391fd7 from target iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7/luns/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7/luns/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7/luns/v_4fe65255-f561-4684-bba2-804bab391fd7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7/luns/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] failed to remove resource iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 because of JDSS resource v_4fe65255-f561-4684-bba2-804bab391fd7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] delete target: iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] delete target iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] failed to remove resource iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 because of JDSS resource iqn.2010-10.org.openstack:4fe65255-f561-4684-bba2-804bab391fd7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] deleating volume v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] get snapshots for volume v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] get volume v_4fe65255-f561-4684-bba2-804bab391fd7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_4fe65255-f561-4684-bba2-804bab391fd7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4fe65255-f561-4684-bba2-804bab391fd7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448949', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '116257', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17131891434258732201', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4d414b15a40eb6a3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238189568', 'san:volume_id': '4d414b15a40eb6a3dfbb5d8ef369b60f779f7875', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89569', 'name': 'v_4fe65255-f561-4684-bba2-804bab391fd7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] delete snapshot v_4fe65255-f561-4684-bba2-804bab391fd7 of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_4fe65255-f561-4684-bba2-804bab391fd7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] snapshot v_4fe65255-f561-4684-bba2-804bab391fd7 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:45:44 user cinder-volume[73393]: DEBUG cinder.quota [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Created reservations ['1c41c341-30a3-451b-93b1-03d68601dc8c', '65c45ec7-54e8-4875-9867-483e9fd17e99', '035b9eda-5a8c-41fb-b663-89a96d3df73f', 'f2a9c8f2-c33f-45a5-a67b-b93349c02780'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238238720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:45 user cinder-volume[73393]: DEBUG cinder.manager [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:45 user cinder-volume[73393]: INFO cinder.volume.manager [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Deleted volume successfully. Apr 14 04:45:45 user cinder-volume[73393]: DEBUG cinder.coordination [None req-92194d7b-15df-4deb-b358-d5d35ad6100f tempest-VolumesImageMetadata-992309861 None] Lock "cinder-4fe65255-f561-4684-bba2-804bab391fd7-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:47 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=61,cinder:DELETE=2,cinder:INSERT=10,cinder:UPDATE=27 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:47 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Flow 'volume_create_manager' (a34db414-6983-4222-818d-899c4bf20367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b8bcb7-d28a-4b74-94e9-b5c52ec0c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b8bcb7-d28a-4b74-94e9-b5c52ec0c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-423063543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8abf4494-2f95-4ea3-812f-37426a51f69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1d1171a13b4adca9e4bc72b0d6e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:45:48Z,use_quota=True,user_id='72c418287fa9448791f65d72911cd6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78de48a4-a773-45cd-94c8-a0e93f2c24dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78de48a4-a773-45cd-94c8-a0e93f2c24dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0efbc4e-4be8-45a4-905c-bd6c9ffb1b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0efbc4e-4be8-45a4-905c-bd6c9ffb1b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abf4494-2f95-4ea3-812f-37426a51f69b', 'volume_name': 'volume-8abf4494-2f95-4ea3-812f-37426a51f69b', 'volume_size': 2}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ad6c27-cfe8-463c-8695-76153ac229bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ad6c27-cfe8-463c-8695-76153ac229bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e088395-a688-471a-9406-13e4586e78cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:48 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Volume 8abf4494-2f95-4ea3-812f-37426a51f69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abf4494-2f95-4ea3-812f-37426a51f69b', 'volume_size': 2} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] creating volume v_8abf4494-2f95-4ea3-812f-37426a51f69b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] create volume {'name': 'v_8abf4494-2f95-4ea3-812f-37426a51f69b', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=55,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=12 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] create export for volume: a8e6a311-8ecf-435d-a4bd-23726576f9bb. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] ensure volume a8e6a311-8ecf-435d-a4bd-23726576f9bb assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] check if targe iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] create target and attach volume a8e6a311-8ecf-435d-a4bd-23726576f9bb to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] create target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8abf4494-2f95-4ea3-812f-37426a51f69b', 'is_clone': False, 'name': 'v_8abf4494-2f95-4ea3-812f-37426a51f69b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e088395-a688-471a-9406-13e4586e78cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abf4494-2f95-4ea3-812f-37426a51f69b', 'volume_size': 2}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1000b1a1-af17-4054-a76e-bf93060d92cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:45:49 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Volume volume-8abf4494-2f95-4ea3-812f-37426a51f69b (8abf4494-2f95-4ea3-812f-37426a51f69b): created successfully Apr 14 04:45:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1000b1a1-af17-4054-a76e-bf93060d92cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:45:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Flow 'volume_create_manager' (a34db414-6983-4222-818d-899c4bf20367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:45:49 user cinder-volume[73393]: INFO cinder.volume.manager [None req-88b92ca1-62ff-4983-b189-af3003a33bf5 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Created volume successfully. Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] create snapshot ca57b361-4164-412d-8ace-19a1adf1de17 for volume 8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] cloning v_8abf4494-2f95-4ea3-812f-37426a51f69b to s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] create snapshot s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] atach volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb to target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ca57b361-4164-412d-8ace-19a1adf1de17'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] create volume s_ca57b361-4164-412d-8ace-19a1adf1de17 from snapshot s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:45:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6636383637643166', 'lun': 0, 'mode': 'wt', 'name': 'v_a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'prod_id': 'Storage', 'scsi_id': 'f6867d1fdcbf324e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] add credentails to target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8abf4494-2f95-4ea3-812f-37426a51f69b@s_ca57b361-4164-412d-8ace-19a1adf1de17', 'is_clone': True, 'full_name': 'Pool-0/s_ca57b361-4164-412d-8ace-19a1adf1de17', 'name': 's_ca57b361-4164-412d-8ace-19a1adf1de17'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 201, 'error': None, 'data': {'name': 'ifwOWKGs'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] volume s_ca57b361-4164-412d-8ace-19a1adf1de17 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] initialize_connection for a8e6a311-8ecf-435d-a4bd-23726576f9bb 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:45:52 user cinder-volume[73393]: INFO cinder.volume.manager [None req-47421af8-4399-428c-8de5-c8a8269e3157 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Create snapshot completed successfully Apr 14 04:45:52 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifwOWKGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'd1917683-8961-4777-a164-2cfbf7e4477f'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:45:52 user cinder-volume[73393]: INFO cinder.volume.manager [req-2df75a5e-ccce-41fe-9383-261dbdc41c00 req-4cca2e56-ba24-48d2-889c-8fd38375ef19 tempest-AttachVolumeShelveTestJSON-2141578557 None] attachment_update completed successfully. Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Acquiring lock "cinder-ca57b361-4164-412d-8ace-19a1adf1de17-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Lock "cinder-ca57b361-4164-412d-8ace-19a1adf1de17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] deleating snapshot s_ca57b361-4164-412d-8ace-19a1adf1de17. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] get snapshots for volume s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] get volume s_ca57b361-4164-412d-8ace-19a1adf1de17 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8abf4494-2f95-4ea3-812f-37426a51f69b@s_ca57b361-4164-412d-8ace-19a1adf1de17', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ca57b361-4164-412d-8ace-19a1adf1de17', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448960', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116270', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9141632888814019259', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9885e7f7d6af6b9f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238144512', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89597', 'name': 's_ca57b361-4164-412d-8ace-19a1adf1de17', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] delete snapshot s_ca57b361-4164-412d-8ace-19a1adf1de17 of volume v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:45:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots/s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots/s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots/s_ca57b361-4164-412d-8ace-19a1adf1de17 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] snapshot s_ca57b361-4164-412d-8ace-19a1adf1de17 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:45:55 user cinder-volume[73393]: DEBUG cinder.quota [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Created reservations ['6d4eb7ee-1f48-47cf-8c8e-58771c03f5b5', '96c9ec13-261a-48f2-a1e7-b4f8cc4cd20a', 'd77b881d-3cc7-4993-a203-5c159c449366', 'c7382796-c97a-43e7-b0da-fda84dc166eb'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Delete snapshot completed successfully. Apr 14 04:45:55 user cinder-volume[73393]: DEBUG cinder.coordination [None req-0eeb0541-f7a8-4b3d-82b6-8720111aa3bb tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Lock "cinder-ca57b361-4164-412d-8ace-19a1adf1de17-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Acquiring lock "cinder-8abf4494-2f95-4ea3-812f-37426a51f69b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Lock "cinder-8abf4494-2f95-4ea3-812f-37426a51f69b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] remove_export for volume: 8abf4494-2f95-4ea3-812f-37426a51f69b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-423063543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8abf4494-2f95-4ea3-812f-37426a51f69b,launched_at=2023-04-14T04:45:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1d1171a13b4adca9e4bc72b0d6e171',provider_auth='CHAP mAahznYP vsRSeCrPwquczN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:45:48Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:45:57Z,updated_at=2023-04-14T04:45:57Z,use_quota=True,user_id='72c418287fa9448791f65d72911cd6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] detach volume v_8abf4494-2f95-4ea3-812f-37426a51f69b from target iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b/luns/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b/luns/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b/luns/v_8abf4494-2f95-4ea3-812f-37426a51f69b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b/luns/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] failed to remove resource iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b because of JDSS resource v_8abf4494-2f95-4ea3-812f-37426a51f69b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] delete target: iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] delete target iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] failed to remove resource iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b because of JDSS resource iqn.2010-10.org.openstack:8abf4494-2f95-4ea3-812f-37426a51f69b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] deleating volume v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] get snapshots for volume v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] get volume v_8abf4494-2f95-4ea3-812f-37426a51f69b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8abf4494-2f95-4ea3-812f-37426a51f69b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448957', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116264', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2416072972281871234', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '635a99c21bb8c195', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238156800', 'san:volume_id': '635a99c21bb8c19513446869c78d080a8ad59710', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89584', 'name': 'v_8abf4494-2f95-4ea3-812f-37426a51f69b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] delete volume:v_8abf4494-2f95-4ea3-812f-37426a51f69b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8abf4494-2f95-4ea3-812f-37426a51f69b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] volume v_8abf4494-2f95-4ea3-812f-37426a51f69b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.quota [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Created reservations ['f3a2d1fb-c66b-4a90-aca3-28a6761decfd', '4e1d08d1-0fc2-4ff6-8188-500e40e21ba2', '8c4106b4-1801-4f17-95b0-c29b5677dd9d', '7cd099cd-0ece-47c5-a959-5eccc4a4adaa'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238251008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.manager [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:45:59 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Deleted volume successfully. Apr 14 04:45:59 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ff317658-da1c-452f-b49f-b845daa44e17 tempest-VolumesSnapshotNegativeTestJSON-411139693 None] Lock "cinder-8abf4494-2f95-4ea3-812f-37426a51f69b-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:46:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=19,cinder:DELETE=3,cinder:SELECT=33,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=49,cinder:UPDATE=20,cinder:INSERT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:46:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:46:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:46:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:46:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:46:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238251008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:46:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:46:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:46:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Flow 'volume_create_manager' (c824971f-5c82-49ab-a08d-aebe4d4e1fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0aa80c-f5a3-41ac-af66-a13e43dbbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0aa80c-f5a3-41ac-af66-a13e43dbbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1041823865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=39ce02ae-5c89-4be1-abd2-8c275a9f7af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:46:54Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f69511e-3f21-415c-9754-d7b9bc61cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f69511e-3f21-415c-9754-d7b9bc61cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ddb2de-d085-4e3a-8022-66d671ba3a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ddb2de-d085-4e3a-8022-66d671ba3a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'volume_name': 'volume-39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df25953-1dd4-4cd6-9973-8c4b88716356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df25953-1dd4-4cd6-9973-8c4b88716356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f074c9-4e26-4636-8a42-1cca55546f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:46:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Volume 39ce02ae-5c89-4be1-abd2-8c275a9f7af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'volume_size': 1} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] creating volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] create volume {'name': 'v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:46:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:46:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'is_clone': False, 'name': 'v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:46:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f074c9-4e26-4636-8a42-1cca55546f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:46:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad8683b-47e9-439a-8332-71cb51b07226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:46:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Volume volume-39ce02ae-5c89-4be1-abd2-8c275a9f7af2 (39ce02ae-5c89-4be1-abd2-8c275a9f7af2): created successfully Apr 14 04:46:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad8683b-47e9-439a-8332-71cb51b07226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:46:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Flow 'volume_create_manager' (c824971f-5c82-49ab-a08d-aebe4d4e1fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:46:55 user cinder-volume[73393]: INFO cinder.volume.manager [None req-90cc40de-79ba-4769-b344-f1bdda1a2f8e tempest-AttachVolumeNegativeTest-1197484356 None] Created volume successfully. Apr 14 04:46:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] create export for volume: 39ce02ae-5c89-4be1-abd2-8c275a9f7af2. {{(pid=73393) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 04:46:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] ensure volume 39ce02ae-5c89-4be1-abd2-8c275a9f7af2 assigned to a proper target {{(pid=73393) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 04:46:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] check if targe iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 exists {{(pid=73393) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 04:46:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:46:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:46:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:46:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] create target and attach volume 39ce02ae-5c89-4be1-abd2-8c275a9f7af2 to it {{(pid=73393) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 04:46:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] create target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 04:46:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:46:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:46:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:46:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] atach volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 to target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 04:46:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:46:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:47:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6364383532363939', 'lun': 0, 'mode': 'wt', 'name': 'v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'prod_id': 'Storage', 'scsi_id': 'cd852699714c2060'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:47:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] add credentails to target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 04:47:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/incoming-users {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:47:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:47:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 201, 'error': None, 'data': {'name': 'CwucHxdV'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/incoming-users {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:47:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] initialize_connection for 39ce02ae-5c89-4be1-abd2-8c275a9f7af2 10.0.0.210. {{(pid=73393) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 04:47:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwucHxdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3a49c816-650e-454d-9aa5-e6dee356cb7c'} {{(pid=73393) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 04:47:03 user cinder-volume[73393]: INFO cinder.volume.manager [req-4d9c49c9-e886-422e-80b9-3047d979622f req-1fa961f9-8346-451a-bbf6-b1c0741ff684 tempest-AttachVolumeNegativeTest-1197484356 None] attachment_update completed successfully. Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] terminate connection for 39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:47:06 user cinder-volume[73393]: INFO cinder.volume.manager [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Terminate volume connection completed successfully. Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Deleting attachment 3a49c816-650e-454d-9aa5-e6dee356cb7c. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] remove_export for volume: 39ce02ae-5c89-4be1-abd2-8c275a9f7af2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1041823865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=39ce02ae-5c89-4be1-abd2-8c275a9f7af2,launched_at=2023-04-14T04:46:56Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth='CHAP CwucHxdV 8fUhXdJ1Ccgjuk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:46:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:47:06Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] detach volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 from target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:47:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:47:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:47:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] delete target: iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:47:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] delete target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:47:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:47:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:47:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:47:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f78e05e-9c46-4c10-9c46-b496239a1516 req-f6415062-a65d-4c8f-a954-79f1a732eff9 tempest-AttachVolumeNegativeTest-1197484356 None] target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:47:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:47:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:47:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:47:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:47:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:47:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238144512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:47:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:47:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:47:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] terminate connection for a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 04:47:38 user cinder-volume[73393]: INFO cinder.volume.manager [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Terminate volume connection completed successfully. Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Deleting attachment d1917683-8961-4777-a164-2cfbf7e4477f. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] remove_export for volume: a8e6a311-8ecf-435d-a4bd-23726576f9bb. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2115435221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a8e6a311-8ecf-435d-a4bd-23726576f9bb,launched_at=2023-04-14T04:43:54Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c10c8cf348e04e44afbaae93a4b60e36',provider_auth='CHAP ifwOWKGs 0tdsbnjORgmJ1Q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:43:52Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T04:47:38Z,use_quota=True,user_id='67d6c699fc524554a6f4983af91d58fc',volume_attachment=,volume_type=,volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] detach volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb from target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:47:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:47:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:47:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] delete target: iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:47:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] delete target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:47:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:47:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:47:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:47:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-51a5cbea-2d00-4679-881d-63f84c8ccba5 req-639d0ed5-fc5e-4489-8337-dda7bf2eca4a tempest-AttachVolumeShelveTestJSON-2141578557 None] target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb deleted {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 04:47:48 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:48:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:48:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:48:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238132224', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:48:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:48:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Acquiring lock "cinder-39ce02ae-5c89-4be1-abd2-8c275a9f7af2-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Lock "cinder-39ce02ae-5c89-4be1-abd2-8c275a9f7af2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] remove_export for volume: 39ce02ae-5c89-4be1-abd2-8c275a9f7af2. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1041823865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=39ce02ae-5c89-4be1-abd2-8c275a9f7af2,launched_at=2023-04-14T04:46:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth='CHAP CwucHxdV 8fUhXdJ1Ccgjuk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:46:54Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:48:47Z,updated_at=2023-04-14T04:48:47Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] detach volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 from target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2/luns/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] failed to remove resource iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 because of JDSS resource v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] delete target: iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] delete target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] failed to remove resource iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 because of JDSS resource iqn.2010-10.org.openstack:39ce02ae-5c89-4be1-abd2-8c275a9f7af2 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] deleating volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] get snapshots for volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] get volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449023', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116294', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6128484058845707727', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cd852699714c2060', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238132224', 'san:volume_id': 'cd852699714c2060c0f62815c9d947b524dfe3bb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90392', 'name': 'v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] delete volume:v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] volume v_39ce02ae-5c89-4be1-abd2-8c275a9f7af2 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:48:49 user cinder-volume[73393]: DEBUG cinder.quota [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Created reservations ['0d65b732-a7ae-40c9-baf2-4ce4303c2630', 'b63eab9d-e57d-4855-9c79-533b54459d87', 'b772e803-b4c0-4eea-bf5e-1d41f4f5777d', '31616976-1e8c-40b1-b5af-cc24f4e30aa4'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:48:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:48:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:48:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238214144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.manager [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:48:50 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Deleted volume successfully. Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f83956da-25dd-4dcc-935a-92cf830ca62c tempest-AttachVolumeNegativeTest-1197484356 None] Lock "cinder-39ce02ae-5c89-4be1-abd2-8c275a9f7af2-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Acquiring lock "cinder-5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Lock "cinder-5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] remove_export for volume: 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835240395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7,launched_at=2023-04-14T04:43:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth='CHAP ULBNyXqg vgd64VslBOtuoX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:43:08Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:48:51Z,updated_at=2023-04-14T04:48:51Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] detach volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 from target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/luns/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] failed to remove resource iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 because of JDSS resource v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] delete target: iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] delete target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] failed to remove resource iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 because of JDSS resource iqn.2010-10.org.openstack:5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] deleating volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] get snapshots for volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] get volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448797', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116191', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10203063634877709744', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f97a2560685273af', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238214144', 'san:volume_id': 'f97a2560685273af8b4743f8e608e17cf7015f59', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89321', 'name': 'v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] delete volume:v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] volume v_5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:48:52 user cinder-volume[73393]: DEBUG cinder.quota [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Created reservations ['f860223b-989b-4566-a7bd-fd15b70587bf', 'df1a5b84-8a46-4d30-b9c8-9334cc185eea', '46573f6a-f90b-42bc-8623-5662934a9684', 'c6babf1f-5d6e-48fe-b1a5-dc640d2f01da'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:48:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:48:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:48:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238320640', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:48:53 user cinder-volume[73393]: DEBUG cinder.manager [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:48:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Deleted volume successfully. Apr 14 04:48:53 user cinder-volume[73393]: DEBUG cinder.coordination [None req-817f1e43-1bf8-4e6c-95bf-7170d736859a tempest-AttachVolumeNegativeTest-1197484356 None] Lock "cinder-5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Acquiring lock "cinder-5615b9ab-7102-4d44-a55e-0e2581c39757-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Lock "cinder-5615b9ab-7102-4d44-a55e-0e2581c39757-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] remove_export for volume: 5615b9ab-7102-4d44-a55e-0e2581c39757. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2063819679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5615b9ab-7102-4d44-a55e-0e2581c39757,launched_at=2023-04-14T04:36:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601e2806907a48d3995cc90b54da3c8c',provider_auth='CHAP TgIjxlbS 2IHuMX4lni6aBR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:36:36Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:48:54Z,updated_at=2023-04-14T04:48:54Z,use_quota=True,user_id='7cab2461ab0d4eb08b62feaf6396bc87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] detach volume v_5615b9ab-7102-4d44-a55e-0e2581c39757 from target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns/v_5615b9ab-7102-4d44-a55e-0e2581c39757'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757/luns/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] failed to remove resource iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 because of JDSS resource v_5615b9ab-7102-4d44-a55e-0e2581c39757 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] delete target: iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] delete target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] failed to remove resource iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 because of JDSS resource iqn.2010-10.org.openstack:5615b9ab-7102-4d44-a55e-0e2581c39757 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] deleating volume v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] get snapshots for volume v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] get volume v_5615b9ab-7102-4d44-a55e-0e2581c39757 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5615b9ab-7102-4d44-a55e-0e2581c39757', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448405', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116015', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9209298584044301381', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '13a468ac533f34f9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238320640', 'san:volume_id': '13a468ac533f34f96928b9000ce1c299d2fd2947', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89988', 'name': 'v_5615b9ab-7102-4d44-a55e-0e2581c39757', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] delete volume:v_5615b9ab-7102-4d44-a55e-0e2581c39757 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5615b9ab-7102-4d44-a55e-0e2581c39757 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] volume v_5615b9ab-7102-4d44-a55e-0e2581c39757 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:48:56 user cinder-volume[73393]: DEBUG cinder.quota [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Created reservations ['ae92f179-b1f0-49d3-a18b-30963120f250', '0a679d37-5ae1-4943-9d22-411cb5e87ead', '761618d9-8a29-4670-b5e5-96c051d7a156', '05be29f6-4f54-4609-8fdb-d112b3469985'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:48:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:48:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:48:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:48:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:48:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238414848', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:48:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:48:57 user cinder-volume[73393]: DEBUG cinder.manager [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:48:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Deleted volume successfully. Apr 14 04:48:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-b459a05c-e2f3-4187-989d-cc685a0e3c99 tempest-AttachVolumeNegativeTest-1197484356 None] Lock "cinder-5615b9ab-7102-4d44-a55e-0e2581c39757-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:48:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=37,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b0e9b7e9-f42b-4cd9-807a-6b91b68a0ebc tempest-GroupSnapshotsTest-538672492 None] Group tempest-GroupSnapshotsTest-Group-582869629: creating Apr 14 04:49:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b0e9b7e9-f42b-4cd9-807a-6b91b68a0ebc tempest-GroupSnapshotsTest-538672492 None] Group tempest-GroupSnapshotsTest-Group-582869629: created successfully Apr 14 04:49:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b0e9b7e9-f42b-4cd9-807a-6b91b68a0ebc tempest-GroupSnapshotsTest-538672492 None] Create group completed successfully. Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (1a9a5457-a80e-4cf8-89b7-30bc33318c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ec9d0-73c9-468c-98ee-569111be4c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ec9d0-73c9-468c-98ee-569111be4c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1802234436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da69212-8435-41db-92ec-03d9ce733a11,host='user@joviandss-2#joviandss-2',id=59952108-8df5-4eb1-9f3b-a98b3dc3dfe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:49:06Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9815b884-c262-465d-9338-f275744a30ed),volume_type_id=9815b884-c262-465d-9338-f275744a30ed)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4c2b82-cf8e-4178-8f93-4750c667ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4c2b82-cf8e-4178-8f93-4750c667ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c91d8c-6d2a-4c76-a6a5-5fe680fc8be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c91d8c-6d2a-4c76-a6a5-5fe680fc8be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'volume_name': 'volume-59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36dc1834-2b95-4712-a1fc-6e6e2f6b787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36dc1834-2b95-4712-a1fc-6e6e2f6b787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac54c88a-ec89-4d4e-a808-83245f9bb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:06 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Volume 59952108-8df5-4eb1-9f3b-a98b3dc3dfe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'volume_size': 1} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] creating volume v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] create volume {'name': 'v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'is_clone': False, 'name': 'v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac54c88a-ec89-4d4e-a808-83245f9bb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b1da4c-3b51-4c12-af8c-38f55193f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:07 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Volume volume-59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 (59952108-8df5-4eb1-9f3b-a98b3dc3dfe5): created successfully Apr 14 04:49:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b1da4c-3b51-4c12-af8c-38f55193f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:07 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (1a9a5457-a80e-4cf8-89b7-30bc33318c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-8d85de2b-b1bc-4fb0-8fde-0be69a118f42 tempest-GroupSnapshotsTest-538672492 None] Created volume successfully. Apr 14 04:49:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=52,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] GroupSnapshot 77fbaf23-58a8-4fad-8d67-db4d0c4e534b: creating. Apr 14 04:49:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Group snapshot 77fbaf23-58a8-4fad-8d67-db4d0c4e534b: creating. {{(pid=73393) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 04:49:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] create snapshot 771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 for volume 59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:49:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] cloning v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 to s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:49:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] create snapshot s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:49:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] create volume s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 from snapshot s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:49:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5@s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06', 'is_clone': True, 'full_name': 'Pool-0/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06', 'name': 's_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] volume s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:49:11 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c6cd4e4c-dba5-497c-807b-a6ce07c36943 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 77fbaf23-58a8-4fad-8d67-db4d0c4e534b: created successfully Apr 14 04:49:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] create volume 07d08487-ad2c-48cc-9486-8e5b8ad49428 from snapshot 771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 04:49:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] cloning s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 to v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:49:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] create snapshot v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:49:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_07d08487-ad2c-48cc-9486-8e5b8ad49428'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] create volume v_07d08487-ad2c-48cc-9486-8e5b8ad49428 from snapshot v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:49:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06@v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'is_clone': True, 'full_name': 'Pool-0/v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'name': 'v_07d08487-ad2c-48cc-9486-8e5b8ad49428'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] get volume v_07d08487-ad2c-48cc-9486-8e5b8ad49428 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06@v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449162', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116340', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1116335186792646002', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cabbfbe2de5981e8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238283776', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90288', 'name': 'v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-56da0f7c-b707-4770-bd5c-04461ccc7ca7 tempest-GroupSnapshotsTest-538672492 None] Create group from source-snapshot-77fbaf23-58a8-4fad-8d67-db4d0c4e534b completed successfully. Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] remove_export for volume: 07d08487-ad2c-48cc-9486-8e5b8ad49428. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68d60dcc-c5a8-4bf5-a012-3a338f919b5b,host='user@joviandss-2#joviandss-2',id=07d08487-ad2c-48cc-9486-8e5b8ad49428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth='CHAP KjqFpeXJ mh3xRjJlO50Xr1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:49:15Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9815b884-c262-465d-9338-f275744a30ed),volume_type_id=9815b884-c262-465d-9338-f275744a30ed) from target:iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] detach volume v_07d08487-ad2c-48cc-9486-8e5b8ad49428 from target iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428/luns/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428/luns/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428/luns/v_07d08487-ad2c-48cc-9486-8e5b8ad49428'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428/luns/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 because of JDSS resource v_07d08487-ad2c-48cc-9486-8e5b8ad49428 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] delete target: iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] delete target iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 because of JDSS resource iqn.2010-10.org.openstack:07d08487-ad2c-48cc-9486-8e5b8ad49428 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] deleating volume v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] get volume v_07d08487-ad2c-48cc-9486-8e5b8ad49428 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06@v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449162', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116340', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1116335186792646002', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cabbfbe2de5981e8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238271488', 'san:volume_id': 'cabbfbe2de5981e86abaa7b5b46d5ce89a3253b4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90288', 'name': 'v_07d08487-ad2c-48cc-9486-8e5b8ad49428', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] delete snapshot v_07d08487-ad2c-48cc-9486-8e5b8ad49428 of volume s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots/v_07d08487-ad2c-48cc-9486-8e5b8ad49428 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] snapshot v_07d08487-ad2c-48cc-9486-8e5b8ad49428 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.quota [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Created reservations ['2ad4ea16-b29d-4026-b428-d519e5cf00fb'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:17 user cinder-volume[73393]: WARNING cinder.quota [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1257457650 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1257457650, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:49:17 user cinder-volume[73393]: WARNING cinder.quota [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1257457650 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1257457650, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.quota [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Created reservations ['bed2af93-6844-4feb-961d-fc8881da98e7', 'b2ec896a-d617-463a-b096-3a1347301192', '57e8d7e4-9896-49d6-a4f3-f4ccb9836e1b', 'd962a92e-dd19-42c4-bc4f-be1a854ed4e3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238296064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.manager [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:49:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6663b00a-a989-44c3-84c5-bdcda2ddbc4f tempest-GroupSnapshotsTest-538672492 None] Delete group completed successfully. Apr 14 04:49:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 77fbaf23-58a8-4fad-8d67-db4d0c4e534b: deleting Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 77fbaf23-58a8-4fad-8d67-db4d0c4e534b: deleting {{(pid=73393) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] deleating snapshot s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] get volume s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5@s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449159', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116334', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12500786712086235115', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1d32b6ca8f389445', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238296064', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89444', 'name': 's_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] delete snapshot s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 of volume v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots/s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] snapshot s_771c88dd-7cd9-4f4c-a6e3-9e8defa2fc06 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:49:21 user cinder-volume[73393]: WARNING cinder.quota [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1257457650 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1257457650, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:49:21 user cinder-volume[73393]: DEBUG cinder.quota [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['24be2358-5c9c-42cb-9d71-f7a40a919b34', '5eb0e09e-c687-40b8-8d75-574dddd04122', '69e93124-4487-4773-a27d-98615c84bdbe', '86a0026c-0707-4266-9194-829dd209ef66'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4bc22d9d-aadb-4dc7-8190-ab65f5138d57 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 77fbaf23-58a8-4fad-8d67-db4d0c4e534b: deleted successfully Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] remove_export for volume: 59952108-8df5-4eb1-9f3b-a98b3dc3dfe5. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1802234436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da69212-8435-41db-92ec-03d9ce733a11,host='user@joviandss-2#joviandss-2',id=59952108-8df5-4eb1-9f3b-a98b3dc3dfe5,launched_at=2023-04-14T04:49:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth='CHAP DIaxFfhg LeT3FMp5mW9Z8w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:06Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:49:22Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9815b884-c262-465d-9338-f275744a30ed),volume_type_id=9815b884-c262-465d-9338-f275744a30ed) from target:iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] detach volume v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 from target iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/luns/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/luns/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/luns/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/luns/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 because of JDSS resource v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] delete target: iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] delete target iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 because of JDSS resource iqn.2010-10.org.openstack:59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] deleating volume v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] get volume v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449155', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116328', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5438899949916178152', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '17e4b4d9c964096a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238308352', 'san:volume_id': '17e4b4d9c964096a524d1a8b2f8c09ed77b59628', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90408', 'name': 'v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] delete volume:v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] volume v_59952108-8df5-4eb1-9f3b-a98b3dc3dfe5 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=74,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.quota [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['b40cb3fd-f7f1-4b8b-8720-38eb1468fc34'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:24 user cinder-volume[73393]: WARNING cinder.db.sqlalchemy.api [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1257457650'] Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.quota [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['49128279-7d1c-47cb-8646-e0d4c4138425', 'f2a60b7f-2126-4adf-a278-73b6a5217f26', '5843f952-4faa-42ff-9cfd-1b5c4ba88809', '7025e158-7d3f-4924-82d4-e56682f3e50d'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:INSERT=8 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238296064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:49:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:49:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2c3b70f8-21b2-4d8d-8f54-3d108583b956 tempest-GroupSnapshotsTest-538672492 None] Delete group completed successfully. Apr 14 04:49:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238390272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:49:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:49:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7a17eb08-b524-4524-be06-e522c760d44e tempest-GroupSnapshotsTest-538672492 None] Group tempest-GroupSnapshotsTest-Group-2070007190: creating Apr 14 04:49:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7a17eb08-b524-4524-be06-e522c760d44e tempest-GroupSnapshotsTest-538672492 None] Group tempest-GroupSnapshotsTest-Group-2070007190: created successfully Apr 14 04:49:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-7a17eb08-b524-4524-be06-e522c760d44e tempest-GroupSnapshotsTest-538672492 None] Create group completed successfully. Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (9c5330b4-8d95-4ae0-a28a-e3fb85881bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4636740f-cd99-4b59-ac35-ca692e399fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4636740f-cd99-4b59-ac35-ca692e399fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-955650261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95533ec8-ef81-40dc-af21-ef7154376eed,host='user@joviandss-2#joviandss-2',id=47873223-95e5-44e1-9f59-320d16db704e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:49:27Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea1496e5-99a7-43e6-baaa-fd85860eeaa9),volume_type_id=ea1496e5-99a7-43e6-baaa-fd85860eeaa9)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c79e10-c377-4ed8-b068-3b9a5b0caed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c79e10-c377-4ed8-b068-3b9a5b0caed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23b0b62-bc7e-4f25-a3ad-404e026a55fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23b0b62-bc7e-4f25-a3ad-404e026a55fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47873223-95e5-44e1-9f59-320d16db704e', 'volume_name': 'volume-47873223-95e5-44e1-9f59-320d16db704e', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e437bf-df1f-42c5-83fb-445fcd0344f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e437bf-df1f-42c5-83fb-445fcd0344f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e14e6eb-a5f6-48eb-ac02-037265fe0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:27 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Volume 47873223-95e5-44e1-9f59-320d16db704e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47873223-95e5-44e1-9f59-320d16db704e', 'volume_size': 1} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] creating volume v_47873223-95e5-44e1-9f59-320d16db704e. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] create volume {'name': 'v_47873223-95e5-44e1-9f59-320d16db704e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_47873223-95e5-44e1-9f59-320d16db704e', 'is_clone': False, 'name': 'v_47873223-95e5-44e1-9f59-320d16db704e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e14e6eb-a5f6-48eb-ac02-037265fe0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47873223-95e5-44e1-9f59-320d16db704e', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c875629e-e281-4f82-9838-51d8f42f2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:28 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Volume volume-47873223-95e5-44e1-9f59-320d16db704e (47873223-95e5-44e1-9f59-320d16db704e): created successfully Apr 14 04:49:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c875629e-e281-4f82-9838-51d8f42f2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:28 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (9c5330b4-8d95-4ae0-a28a-e3fb85881bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fbbd8fa9-9847-4b45-a495-5b075a325ac3 tempest-GroupSnapshotsTest-538672492 None] Created volume successfully. Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (bd813a7f-579d-43e5-acad-15c75c7a8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d779afe-ed2e-47e3-9d28-613f8bf1683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d779afe-ed2e-47e3-9d28-613f8bf1683d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-633436960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95533ec8-ef81-40dc-af21-ef7154376eed,host='user@joviandss-2#joviandss-2',id=dbe04900-f117-4bd0-a49a-28fdf8eaec18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:49:30Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea1496e5-99a7-43e6-baaa-fd85860eeaa9),volume_type_id=ea1496e5-99a7-43e6-baaa-fd85860eeaa9)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f818f7-2e98-47b4-9cca-7d773082e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f818f7-2e98-47b4-9cca-7d773082e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07d333-ed03-4a3f-93ad-5e49d83c3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07d333-ed03-4a3f-93ad-5e49d83c3910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'volume_name': 'volume-dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb77b72f-acfe-48b1-a7d9-96888d5aaee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb77b72f-acfe-48b1-a7d9-96888d5aaee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39aa94c-38cc-4a62-9b01-b97c4f1a504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:29 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Volume dbe04900-f117-4bd0-a49a-28fdf8eaec18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'volume_size': 1} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] creating volume v_dbe04900-f117-4bd0-a49a-28fdf8eaec18. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] create volume {'name': 'v_dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'is_clone': False, 'name': 'v_dbe04900-f117-4bd0-a49a-28fdf8eaec18'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39aa94c-38cc-4a62-9b01-b97c4f1a504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7f1f27-11dc-4558-be7d-088216cabb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:30 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Volume volume-dbe04900-f117-4bd0-a49a-28fdf8eaec18 (dbe04900-f117-4bd0-a49a-28fdf8eaec18): created successfully Apr 14 04:49:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7f1f27-11dc-4558-be7d-088216cabb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (bd813a7f-579d-43e5-acad-15c75c7a8b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c30b07ac-a73a-43ec-a563-6d595ce64a3f tempest-GroupSnapshotsTest-538672492 None] Created volume successfully. Apr 14 04:49:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-feee66c4-9672-4229-9e48-74529b3a7c19 tempest-GroupSnapshotsTest-538672492 None] Update group completed successfully. Apr 14 04:49:33 user cinder-volume[73393]: INFO cinder.volume.manager [None req-58307418-5e48-4b27-a02f-078a869ed169 tempest-GroupSnapshotsTest-538672492 None] Update group completed successfully. Apr 14 04:49:34 user cinder-volume[73393]: INFO cinder.volume.manager [None req-36682c02-1877-46a6-a1e0-75ff7cb2c2e1 tempest-GroupSnapshotsTest-538672492 None] Update group completed successfully. Apr 14 04:49:35 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2c21d424-c363-4a8f-9ecf-afa3e59016ed tempest-GroupSnapshotsTest-538672492 None] Update group completed successfully. Apr 14 04:49:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] GroupSnapshot f1ba8e82-9904-417e-b14d-e968cb0c1d3a: creating. Apr 14 04:49:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Group snapshot f1ba8e82-9904-417e-b14d-e968cb0c1d3a: creating. {{(pid=73393) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 04:49:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] create snapshot 4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 for volume 47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:49:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] cloning v_47873223-95e5-44e1-9f59-320d16db704e to s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:49:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] create snapshot s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:49:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] create volume s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 from snapshot s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:49:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_47873223-95e5-44e1-9f59-320d16db704e@s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8', 'is_clone': True, 'full_name': 'Pool-0/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8', 'name': 's_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] volume s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] create snapshot cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf for volume dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] cloning v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 to s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] create snapshot s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] create volume s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf from snapshot s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:49:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18@s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf', 'is_clone': True, 'full_name': 'Pool-0/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf', 'name': 's_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] volume s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:49:41 user cinder-volume[73393]: INFO cinder.volume.manager [None req-3ca896a5-dc8e-4609-99f9-52ac2c3cbc76 tempest-GroupSnapshotsTest-538672492 None] group_snapshot f1ba8e82-9904-417e-b14d-e968cb0c1d3a: created successfully Apr 14 04:49:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] group_snapshot f1ba8e82-9904-417e-b14d-e968cb0c1d3a: deleting Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] group_snapshot f1ba8e82-9904-417e-b14d-e968cb0c1d3a: deleting {{(pid=73393) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] deleating snapshot s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] get volume s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_47873223-95e5-44e1-9f59-320d16db704e@s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449187', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116363', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7890165844745688972', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3c5461a58557da1d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238177280', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89841', 'name': 's_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] delete snapshot s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 of volume v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:49:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots/s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] snapshot s_4ed40993-c1b9-4d5b-a017-baf9ecb0b2d8 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] deleating snapshot s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] get volume s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18@s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449189', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116369', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7693655964187435666', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5c7cd2cec8af3ec0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238201856', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89457', 'name': 's_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] delete snapshot s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf of volume v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:49:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:45 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots/s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] snapshot s_cfbb08ea-25b6-47d1-9f2d-7cce0fedafdf deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:49:46 user cinder-volume[73393]: WARNING cinder.quota [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-937238512 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-937238512, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:49:46 user cinder-volume[73393]: WARNING cinder.quota [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-937238512 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-937238512, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:49:46 user cinder-volume[73393]: DEBUG cinder.quota [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Created reservations ['9cd8e5ee-ebb5-4ac7-ad8a-1c33818334db', '3bf7437a-4083-4f5f-9391-6ce860804712', '89ca4414-fedc-4bcb-a158-e98e70f7a93c', '75cf85b6-c1db-4760-b941-768e473c72dc'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:46 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=73,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:46 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=67,cinder:UPDATE=31,cinder:INSERT=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:46 user cinder-volume[73393]: DEBUG cinder.quota [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] Created reservations ['a70e3466-8a6d-4b6d-9e63-76930de95b68', '821d1fca-0d41-4946-9771-3da8ec133ace', '47a796fc-5bee-4bce-aada-9e720d691a0e', '16e05420-96cc-4982-b3b3-03c3ee0f2541'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0bef9741-d900-403f-973b-ec42e015363d tempest-GroupSnapshotsTest-538672492 None] group_snapshot f1ba8e82-9904-417e-b14d-e968cb0c1d3a: deleted successfully Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] remove_export for volume: 47873223-95e5-44e1-9f59-320d16db704e. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-955650261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95533ec8-ef81-40dc-af21-ef7154376eed,host='user@joviandss-2#joviandss-2',id=47873223-95e5-44e1-9f59-320d16db704e,launched_at=2023-04-14T04:49:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth='CHAP WqTtKuDF gaL2jlQoNkfHSI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:27Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:49:48Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea1496e5-99a7-43e6-baaa-fd85860eeaa9),volume_type_id=ea1496e5-99a7-43e6-baaa-fd85860eeaa9) from target:iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] detach volume v_47873223-95e5-44e1-9f59-320d16db704e from target iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e/luns/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e/luns/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e/luns/v_47873223-95e5-44e1-9f59-320d16db704e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e/luns/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e because of JDSS resource v_47873223-95e5-44e1-9f59-320d16db704e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] delete target: iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] delete target iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e because of JDSS resource iqn.2010-10.org.openstack:47873223-95e5-44e1-9f59-320d16db704e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] deleating volume v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] get volume v_47873223-95e5-44e1-9f59-320d16db704e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_47873223-95e5-44e1-9f59-320d16db704e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449176', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116352', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10081403934048416068', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '792fcbebf7b08c5c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238214144', 'san:volume_id': '792fcbebf7b08c5cb55208535dadbd24a5612382', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90302', 'name': 'v_47873223-95e5-44e1-9f59-320d16db704e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] delete volume:v_47873223-95e5-44e1-9f59-320d16db704e recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47873223-95e5-44e1-9f59-320d16db704e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] volume v_47873223-95e5-44e1-9f59-320d16db704e deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] remove_export for volume: dbe04900-f117-4bd0-a49a-28fdf8eaec18. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-633436960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95533ec8-ef81-40dc-af21-ef7154376eed,host='user@joviandss-2#joviandss-2',id=dbe04900-f117-4bd0-a49a-28fdf8eaec18,launched_at=2023-04-14T04:49:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth='CHAP HhNUOWYq s3zj9MNVSo0u5H',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:30Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:49:48Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea1496e5-99a7-43e6-baaa-fd85860eeaa9),volume_type_id=ea1496e5-99a7-43e6-baaa-fd85860eeaa9) from target:iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] detach volume v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 from target iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18/luns/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18/luns/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18/luns/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18/luns/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 because of JDSS resource v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] delete target: iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] delete target iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 because of JDSS resource iqn.2010-10.org.openstack:dbe04900-f117-4bd0-a49a-28fdf8eaec18 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] deleating volume v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] get volume v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449178', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116356', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1171261512256115870', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '952178bbff850eb3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238296064', 'san:volume_id': '952178bbff850eb32d2af74ba57040206b1c3c29', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90420', 'name': 'v_dbe04900-f117-4bd0-a49a-28fdf8eaec18', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] delete volume:v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:52 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] volume v_dbe04900-f117-4bd0-a49a-28fdf8eaec18 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:49:52 user cinder-volume[73393]: DEBUG cinder.quota [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['f7dd5f45-443d-40b4-8da7-6cd60c5c6b1a'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:52 user cinder-volume[73393]: WARNING cinder.quota [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-937238512 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-937238512, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:49:52 user cinder-volume[73393]: DEBUG cinder.quota [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['23df23c6-e891-40a3-9b9e-64a1c669216e', '34b42a2d-2f67-4a30-8230-382859124015', 'f88ddcd6-014f-4e8f-aa0d-108a65c00de3', '686f9aa0-73f4-4fba-813c-193acdd721a0'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.quota [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['dd9ce43e-c896-4322-a7bc-e0436b78cf0e', 'f6c4bc7d-4d30-443f-a691-0f86390f5708', 'aafc327e-2d80-437c-8075-a1f4fb001781', '85b4bde7-c8b1-48eb-9abc-d05a28409e51'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238377984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:49:53 user cinder-volume[73393]: DEBUG cinder.manager [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:49:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-56cbc0bd-6bc8-459f-b56c-41e5914944d6 tempest-GroupSnapshotsTest-538672492 None] Delete group completed successfully. Apr 14 04:49:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-12fc363a-9f1e-438e-b3c4-354c12fc5fa1 tempest-GroupSnapshotsTest-538672492 None] Group tempest-GroupSnapshotsTest-Group-1034620978: creating Apr 14 04:49:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-12fc363a-9f1e-438e-b3c4-354c12fc5fa1 tempest-GroupSnapshotsTest-538672492 None] Group tempest-GroupSnapshotsTest-Group-1034620978: created successfully Apr 14 04:49:53 user cinder-volume[73393]: INFO cinder.volume.manager [None req-12fc363a-9f1e-438e-b3c4-354c12fc5fa1 tempest-GroupSnapshotsTest-538672492 None] Create group completed successfully. Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (f2781e7c-2bca-4004-9d6b-2df26b2b5294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3eb9df-5acd-42e8-8220-4f0f7fdf669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3eb9df-5acd-42e8-8220-4f0f7fdf669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938390437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f136d65-5970-4e91-baa8-5302857a693a,host='user@joviandss-2#joviandss-2',id=a92166ce-2579-456e-b39c-1ffa1f26075a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:49:55Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71711f0c-acd1-41f0-8ed1-197489990c1a),volume_type_id=71711f0c-acd1-41f0-8ed1-197489990c1a)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4c8194-0e52-4700-b695-05e6b098c927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4c8194-0e52-4700-b695-05e6b098c927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af2769c-a21a-4fec-9bd6-efad266e4c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af2769c-a21a-4fec-9bd6-efad266e4c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92166ce-2579-456e-b39c-1ffa1f26075a', 'volume_name': 'volume-a92166ce-2579-456e-b39c-1ffa1f26075a', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eca2ee9-4cbf-43ed-a8dc-9b32787682e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eca2ee9-4cbf-43ed-a8dc-9b32787682e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5927cbba-b3df-431b-976a-4231ff776bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:55 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Volume a92166ce-2579-456e-b39c-1ffa1f26075a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92166ce-2579-456e-b39c-1ffa1f26075a', 'volume_size': 1} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] creating volume v_a92166ce-2579-456e-b39c-1ffa1f26075a. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] create volume {'name': 'v_a92166ce-2579-456e-b39c-1ffa1f26075a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a92166ce-2579-456e-b39c-1ffa1f26075a', 'is_clone': False, 'name': 'v_a92166ce-2579-456e-b39c-1ffa1f26075a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5927cbba-b3df-431b-976a-4231ff776bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92166ce-2579-456e-b39c-1ffa1f26075a', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71482354-16d1-4a54-886f-0696f64ca1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:49:56 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Volume volume-a92166ce-2579-456e-b39c-1ffa1f26075a (a92166ce-2579-456e-b39c-1ffa1f26075a): created successfully Apr 14 04:49:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71482354-16d1-4a54-886f-0696f64ca1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:49:56 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Flow 'volume_create_manager' (f2781e7c-2bca-4004-9d6b-2df26b2b5294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:49:56 user cinder-volume[73393]: INFO cinder.volume.manager [None req-526d9850-0b0c-4522-bde8-7e2a4849cf91 tempest-GroupSnapshotsTest-538672492 None] Created volume successfully. Apr 14 04:49:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] GroupSnapshot 186cd80b-c516-4f35-9ce5-fa8de6b01865: creating. Apr 14 04:49:57 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Group snapshot 186cd80b-c516-4f35-9ce5-fa8de6b01865: creating. {{(pid=73393) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 04:49:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] create snapshot a6257dd1-08cc-48de-97aa-d0cdbab12944 for volume a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:49:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] cloning v_a92166ce-2579-456e-b39c-1ffa1f26075a to s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:49:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] create snapshot s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:49:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_a6257dd1-08cc-48de-97aa-d0cdbab12944'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] create volume s_a6257dd1-08cc-48de-97aa-d0cdbab12944 from snapshot s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:49:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a92166ce-2579-456e-b39c-1ffa1f26075a@s_a6257dd1-08cc-48de-97aa-d0cdbab12944', 'is_clone': True, 'full_name': 'Pool-0/s_a6257dd1-08cc-48de-97aa-d0cdbab12944', 'name': 's_a6257dd1-08cc-48de-97aa-d0cdbab12944'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:49:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:49:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:49:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] volume s_a6257dd1-08cc-48de-97aa-d0cdbab12944 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:49:59 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=34,cinder:SELECT=59,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:59 user cinder-volume[73393]: INFO cinder.volume.manager [None req-61014a8a-30e4-439c-9e45-d85291dce005 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 186cd80b-c516-4f35-9ce5-fa8de6b01865: created successfully Apr 14 04:50:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 186cd80b-c516-4f35-9ce5-fa8de6b01865: deleting Apr 14 04:50:00 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 186cd80b-c516-4f35-9ce5-fa8de6b01865: deleting {{(pid=73393) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 04:50:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] deleating snapshot s_a6257dd1-08cc-48de-97aa-d0cdbab12944. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:50:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] get volume s_a6257dd1-08cc-48de-97aa-d0cdbab12944 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a92166ce-2579-456e-b39c-1ffa1f26075a@s_a6257dd1-08cc-48de-97aa-d0cdbab12944', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_a6257dd1-08cc-48de-97aa-d0cdbab12944', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449207', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116389', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6496890976651528022', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '78d4ed3fa2989acd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238271488', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90762', 'name': 's_a6257dd1-08cc-48de-97aa-d0cdbab12944', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] delete snapshot s_a6257dd1-08cc-48de-97aa-d0cdbab12944 of volume v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots/s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots/s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots/s_a6257dd1-08cc-48de-97aa-d0cdbab12944 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] snapshot s_a6257dd1-08cc-48de-97aa-d0cdbab12944 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:50:03 user cinder-volume[73393]: WARNING cinder.quota [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1135831077 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1135831077, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:50:03 user cinder-volume[73393]: WARNING cinder.quota [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1135831077 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1135831077, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:50:03 user cinder-volume[73393]: DEBUG cinder.quota [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['1785aa83-936e-4d08-95bd-33854039fcdb', 'd626106a-6a2f-4d9b-9534-f9c04a914d8f', '151af922-9569-4b8f-ba9d-4129b55fa26e', 'ab55145f-28b4-4216-984a-d246b4d18d90'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:03 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=62,cinder:INSERT=8,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:03 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1174d417-e758-4eb8-99ae-a56e205a59d4 tempest-GroupSnapshotsTest-538672492 None] group_snapshot 186cd80b-c516-4f35-9ce5-fa8de6b01865: deleted successfully Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] remove_export for volume: a92166ce-2579-456e-b39c-1ffa1f26075a. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938390437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f136d65-5970-4e91-baa8-5302857a693a,host='user@joviandss-2#joviandss-2',id=a92166ce-2579-456e-b39c-1ffa1f26075a,launched_at=2023-04-14T04:49:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b5f8863cac4c2fa5e49346e537af1b',provider_auth='CHAP DZIQSHgy EF4QSLdNJmvBet',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:49:55Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T04:50:04Z,use_quota=True,user_id='eceec66d45d242eab46e8465f15940f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71711f0c-acd1-41f0-8ed1-197489990c1a),volume_type_id=71711f0c-acd1-41f0-8ed1-197489990c1a) from target:iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] detach volume v_a92166ce-2579-456e-b39c-1ffa1f26075a from target iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a/luns/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a/luns/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a/luns/v_a92166ce-2579-456e-b39c-1ffa1f26075a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a/luns/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a because of JDSS resource v_a92166ce-2579-456e-b39c-1ffa1f26075a DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] delete target: iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] delete target iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] failed to remove resource iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a because of JDSS resource iqn.2010-10.org.openstack:a92166ce-2579-456e-b39c-1ffa1f26075a DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] deleating volume v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] get snapshots for volume v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] get volume v_a92166ce-2579-456e-b39c-1ffa1f26075a info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a92166ce-2579-456e-b39c-1ffa1f26075a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449204', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116383', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15026138843345394553', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b65ffdc335ccc493', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238271488', 'san:volume_id': 'b65ffdc335ccc493b18d301d1a748d386a49fdc6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90755', 'name': 'v_a92166ce-2579-456e-b39c-1ffa1f26075a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] delete volume:v_a92166ce-2579-456e-b39c-1ffa1f26075a recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92166ce-2579-456e-b39c-1ffa1f26075a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] volume v_a92166ce-2579-456e-b39c-1ffa1f26075a deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.quota [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['1206ae77-6a6f-4595-acf9-0b3dc4383f5f'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:06 user cinder-volume[73393]: WARNING cinder.quota [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1135831077 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1135831077, it is now deprecated. Please use the default quota class for default quota. Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.quota [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Created reservations ['b0e81543-6cd4-491e-823a-2cfab214f452', 'ee7554e4-f65c-49a4-922f-42c2405615f8', 'b8fe2a87-7cc1-40b0-96bc-f9f862b24449', 'f76b8b6a-d071-4391-9b90-27e1be6d64c9'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238365696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:07 user cinder-volume[73393]: DEBUG cinder.manager [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:07 user cinder-volume[73393]: INFO cinder.volume.manager [None req-4e01d9d6-0fe2-4f4c-a24e-68ec957b01d6 tempest-GroupSnapshotsTest-538672492 None] Delete group completed successfully. Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Flow 'volume_create_manager' (bf1e7a14-6186-416c-ba72-87922bbfa0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3defc626-826a-4acb-a692-dbdbf49f816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3defc626-826a-4acb-a692-dbdbf49f816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-406339587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e90c124-9e5f-4a45-b3a0-79c0d934a9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878859223a4a258ff7fd14fb167f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:11Z,use_quota=True,user_id='b831785260c4483e81685fd9a5c6df78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24e8023-6794-4463-a628-881dc4b41768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24e8023-6794-4463-a628-881dc4b41768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1871a375-4669-4f13-83da-cc540fdacf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1871a375-4669-4f13-83da-cc540fdacf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'volume_name': 'volume-8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e22b341-441e-4633-9f29-43285d8d5360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e22b341-441e-4633-9f29-43285d8d5360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58eefea-4e3a-414c-aa6a-be451d725a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:11 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Volume 8e90c124-9e5f-4a45-b3a0-79c0d934a9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'volume_size': 1} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] creating volume v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] create volume {'name': 'v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'is_clone': False, 'name': 'v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58eefea-4e3a-414c-aa6a-be451d725a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6835d3db-faed-4ba8-bc8c-034fb832066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:12 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Volume volume-8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 (8e90c124-9e5f-4a45-b3a0-79c0d934a9c3): created successfully Apr 14 04:50:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6835d3db-faed-4ba8-bc8c-034fb832066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:12 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Flow 'volume_create_manager' (bf1e7a14-6186-416c-ba72-87922bbfa0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:12 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f2f09b87-37ee-426b-9e09-7f08ee8a1533 tempest-VolumesListAdminTestJSON-1597538331 None] Created volume successfully. Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Flow 'volume_create_manager' (3c8b9c67-be59-447f-84c1-0253a1aad033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0764a441-4829-4719-befb-69b37408ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0764a441-4829-4719-befb-69b37408ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-351063608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=92f5fcc4-269c-427f-84b7-b3f4457bb8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878859223a4a258ff7fd14fb167f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:14Z,use_quota=True,user_id='b831785260c4483e81685fd9a5c6df78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1864e8b1-9179-484e-9667-ca0d4ee97e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1864e8b1-9179-484e-9667-ca0d4ee97e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fbdfed-5d25-4283-ad52-b0b6fdc67b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fbdfed-5d25-4283-ad52-b0b6fdc67b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'volume_name': 'volume-92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c7b4c4-837e-48ac-a937-3f9511211908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c7b4c4-837e-48ac-a937-3f9511211908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a58eb6a-44d6-4b82-b460-61ffb263c741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Volume 92f5fcc4-269c-427f-84b7-b3f4457bb8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'volume_size': 1} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] creating volume v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] create volume {'name': 'v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'is_clone': False, 'name': 'v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a58eb6a-44d6-4b82-b460-61ffb263c741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb520f0-014c-4729-b428-cd4ac39e01e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:14 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Volume volume-92f5fcc4-269c-427f-84b7-b3f4457bb8e5 (92f5fcc4-269c-427f-84b7-b3f4457bb8e5): created successfully Apr 14 04:50:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb520f0-014c-4729-b428-cd4ac39e01e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Flow 'volume_create_manager' (3c8b9c67-be59-447f-84c1-0253a1aad033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-992c77c1-6592-4c81-8c0e-722cd9732bc6 tempest-VolumesListAdminTestJSON-1597538331 None] Created volume successfully. Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Flow 'volume_create_manager' (da7495c7-8dc1-4bd7-8d0c-3c173880b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcf270d-7c49-4f79-ac3c-0dd6c082e12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcf270d-7c49-4f79-ac3c-0dd6c082e12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1017703423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6bf5f678-8f9e-4ead-af2f-87993f66dbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878859223a4a258ff7fd14fb167f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:16Z,use_quota=True,user_id='b831785260c4483e81685fd9a5c6df78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c327e8-e8dd-459e-ae95-2fb3544ca16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c327e8-e8dd-459e-ae95-2fb3544ca16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f02bc3-2a7a-4328-aca5-15be120fa57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f02bc3-2a7a-4328-aca5-15be120fa57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'volume_name': 'volume-6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c25222-095d-4545-80be-2f4fe7c38b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c25222-095d-4545-80be-2f4fe7c38b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e849092-c5e1-4cda-b6cc-633395f2594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Volume 6bf5f678-8f9e-4ead-af2f-87993f66dbb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'volume_size': 1} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] creating volume v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] create volume {'name': 'v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'is_clone': False, 'name': 'v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e849092-c5e1-4cda-b6cc-633395f2594c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484463f1-d8e0-4f78-9cdd-2fde73c8a6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:17 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Volume volume-6bf5f678-8f9e-4ead-af2f-87993f66dbb0 (6bf5f678-8f9e-4ead-af2f-87993f66dbb0): created successfully Apr 14 04:50:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484463f1-d8e0-4f78-9cdd-2fde73c8a6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:17 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Flow 'volume_create_manager' (da7495c7-8dc1-4bd7-8d0c-3c173880b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:17 user cinder-volume[73393]: INFO cinder.volume.manager [None req-22cdda59-c034-42bd-969c-d5927bf088fc tempest-VolumesListAdminTestJSON-1597538331 None] Created volume successfully. Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Flow 'volume_create_manager' (1c568f9a-bb2b-4837-87ed-050b32f90a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d517328-b42d-4457-8bf6-8470a985ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d517328-b42d-4457-8bf6-8470a985ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=96c98997-f7de-4dda-806c-eaddb31da9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadc3cd7e8fb4fd5ba587aa7c45a5399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:19Z,use_quota=True,user_id='698af91c9abe4b2bab97306cebed88bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4b4c4b-a0ee-4c0f-8a10-dec7299406e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4b4c4b-a0ee-4c0f-8a10-dec7299406e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244008c6-0366-4cce-869f-cbc278106c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244008c6-0366-4cce-869f-cbc278106c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c98997-f7de-4dda-806c-eaddb31da9ff', 'volume_name': 'volume-96c98997-f7de-4dda-806c-eaddb31da9ff', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346c08f3-251b-46f8-9741-a6b51f874f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346c08f3-251b-46f8-9741-a6b51f874f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6270f0-18ee-4852-9015-52c1b70aad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:18 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Volume 96c98997-f7de-4dda-806c-eaddb31da9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c98997-f7de-4dda-806c-eaddb31da9ff', 'volume_size': 1} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] creating volume v_96c98997-f7de-4dda-806c-eaddb31da9ff. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] create volume {'name': 'v_96c98997-f7de-4dda-806c-eaddb31da9ff', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:19 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_96c98997-f7de-4dda-806c-eaddb31da9ff', 'is_clone': False, 'name': 'v_96c98997-f7de-4dda-806c-eaddb31da9ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6270f0-18ee-4852-9015-52c1b70aad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c98997-f7de-4dda-806c-eaddb31da9ff', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8f472-aae3-4d04-8bfc-5c132d789687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:19 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Volume volume-96c98997-f7de-4dda-806c-eaddb31da9ff (96c98997-f7de-4dda-806c-eaddb31da9ff): created successfully Apr 14 04:50:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8f472-aae3-4d04-8bfc-5c132d789687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:19 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Flow 'volume_create_manager' (1c568f9a-bb2b-4837-87ed-050b32f90a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:19 user cinder-volume[73393]: INFO cinder.volume.manager [None req-295474ec-ae84-4e38-8942-984acdeca1eb tempest-VolumesListAdminTestJSON-599210078 None] Created volume successfully. Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Acquiring lock "cinder-96c98997-f7de-4dda-806c-eaddb31da9ff-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.coordination [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Lock "cinder-96c98997-f7de-4dda-806c-eaddb31da9ff-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=63,cinder:INSERT=4,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] remove_export for volume: 96c98997-f7de-4dda-806c-eaddb31da9ff. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=96c98997-f7de-4dda-806c-eaddb31da9ff,launched_at=2023-04-14T04:50:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadc3cd7e8fb4fd5ba587aa7c45a5399',provider_auth='CHAP srluShAv L5X9BGO1ndIahw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:19Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:50:21Z,updated_at=2023-04-14T04:50:21Z,use_quota=True,user_id='698af91c9abe4b2bab97306cebed88bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] detach volume v_96c98997-f7de-4dda-806c-eaddb31da9ff from target iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff/luns/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff/luns/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff/luns/v_96c98997-f7de-4dda-806c-eaddb31da9ff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff/luns/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] failed to remove resource iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff because of JDSS resource v_96c98997-f7de-4dda-806c-eaddb31da9ff DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] delete target: iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] delete target iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] failed to remove resource iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff because of JDSS resource iqn.2010-10.org.openstack:96c98997-f7de-4dda-806c-eaddb31da9ff DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] deleating volume v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] get snapshots for volume v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Acquiring lock "cinder-6bf5f678-8f9e-4ead-af2f-87993f66dbb0-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Lock "cinder-6bf5f678-8f9e-4ead-af2f-87993f66dbb0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] remove_export for volume: 6bf5f678-8f9e-4ead-af2f-87993f66dbb0. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1017703423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6bf5f678-8f9e-4ead-af2f-87993f66dbb0,launched_at=2023-04-14T04:50:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878859223a4a258ff7fd14fb167f49',provider_auth='CHAP YcAsONPt IaQ5WAuVFymYjk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:16Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:50:21Z,updated_at=2023-04-14T04:50:21Z,use_quota=True,user_id='b831785260c4483e81685fd9a5c6df78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] detach volume v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 from target iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0/luns/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0/luns/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0/luns/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0/luns/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] failed to remove resource iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 because of JDSS resource v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] delete target: iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] delete target iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] failed to remove resource iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 because of JDSS resource iqn.2010-10.org.openstack:6bf5f678-8f9e-4ead-af2f-87993f66dbb0 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] deleating volume v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] get snapshots for volume v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] get volume v_96c98997-f7de-4dda-806c-eaddb31da9ff info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_96c98997-f7de-4dda-806c-eaddb31da9ff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449228', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116411', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11301351798481475324', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ca916925bd65149d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238050304', 'san:volume_id': 'ca916925bd65149df01bd5ab64928b9ea48ae7ee', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90795', 'name': 'v_96c98997-f7de-4dda-806c-eaddb31da9ff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] delete volume:v_96c98997-f7de-4dda-806c-eaddb31da9ff recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] get volume v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449225', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116407', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8433484550028316687', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7c1e549a4bfdb1d5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238050304', 'san:volume_id': '7c1e549a4bfdb1d58d5bc9b1fa079e5cf4af17af', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90786', 'name': 'v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] delete volume:v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96c98997-f7de-4dda-806c-eaddb31da9ff {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] volume v_96c98997-f7de-4dda-806c-eaddb31da9ff deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Created reservations ['ab059e73-f2c0-4b6b-8e54-290a16b2ec7f', '24111b51-166b-476f-b4f9-4d5b01098a58', '72a649cf-3188-4690-a823-58b1a39e1e8e', '994add43-0d31-4f0a-9778-73005df9787e'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238226432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:24 user cinder-volume[73393]: INFO cinder.volume.manager [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Deleted volume successfully. Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-552b8815-df1a-4f48-b59c-6b1780ad28c5 tempest-VolumesListAdminTestJSON-599210078 None] Lock "cinder-96c98997-f7de-4dda-806c-eaddb31da9ff-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] volume v_6bf5f678-8f9e-4ead-af2f-87993f66dbb0 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.quota [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Created reservations ['d548bea0-efdd-4f05-b04e-41b6de768d09', '83ca4620-dcb6-45e6-84a0-d43736fad562', 'b3d7e3e4-1681-4789-a0c3-610e47ef63fe', 'df850ca0-9cba-42e3-9941-900a5182a0b1'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=56,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238226432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:24 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238226432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:25 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Deleted volume successfully. Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1a46594c-fc1a-4499-bea7-c4d672da0b89 tempest-VolumesListAdminTestJSON-1597538331 None] Lock "cinder-6bf5f678-8f9e-4ead-af2f-87993f66dbb0-delete_volume" released by "delete_volume" :: held 4.091s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Acquiring lock "cinder-92f5fcc4-269c-427f-84b7-b3f4457bb8e5-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Lock "cinder-92f5fcc4-269c-427f-84b7-b3f4457bb8e5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] remove_export for volume: 92f5fcc4-269c-427f-84b7-b3f4457bb8e5. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-351063608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=92f5fcc4-269c-427f-84b7-b3f4457bb8e5,launched_at=2023-04-14T04:50:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878859223a4a258ff7fd14fb167f49',provider_auth='CHAP fRlLJTth NLIm3TAhWvVe0p',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:14Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:50:25Z,updated_at=2023-04-14T04:50:25Z,use_quota=True,user_id='b831785260c4483e81685fd9a5c6df78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] detach volume v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 from target iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5/luns/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5/luns/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5/luns/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5/luns/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] failed to remove resource iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 because of JDSS resource v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] delete target: iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] delete target iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] failed to remove resource iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 because of JDSS resource iqn.2010-10.org.openstack:92f5fcc4-269c-427f-84b7-b3f4457bb8e5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] deleating volume v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] get snapshots for volume v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] get volume v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449222', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116403', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18131792292288367670', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd4684e21c068419f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238226432', 'san:volume_id': 'd4684e21c068419fb1d88aa38f05bbec771ed895', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90777', 'name': 'v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] delete volume:v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] volume v_92f5fcc4-269c-427f-84b7-b3f4457bb8e5 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:27 user cinder-volume[73393]: DEBUG cinder.quota [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Created reservations ['ee47b066-d519-43c5-a7bb-20cc2985af65', 'f0788afb-38cc-4cd8-9516-9f5f128611dc', '1b0d4f5d-45e9-4464-8636-bc607836affb', '1e324827-fcf8-431e-8ee3-4844b54cbaab'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238296064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.manager [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Deleted volume successfully. Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bf3cb8a3-90a5-497e-b0e2-a74f8c46abdd tempest-VolumesListAdminTestJSON-1597538331 None] Lock "cinder-92f5fcc4-269c-427f-84b7-b3f4457bb8e5-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Acquiring lock "cinder-8e90c124-9e5f-4a45-b3a0-79c0d934a9c3-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Lock "cinder-8e90c124-9e5f-4a45-b3a0-79c0d934a9c3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] remove_export for volume: 8e90c124-9e5f-4a45-b3a0-79c0d934a9c3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-406339587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e90c124-9e5f-4a45-b3a0-79c0d934a9c3,launched_at=2023-04-14T04:50:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878859223a4a258ff7fd14fb167f49',provider_auth='CHAP ToGFKQdL PEOrTQH3iS9bUV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:11Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:50:29Z,updated_at=2023-04-14T04:50:29Z,use_quota=True,user_id='b831785260c4483e81685fd9a5c6df78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] detach volume v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 from target iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3/luns/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3/luns/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3/luns/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3/luns/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] failed to remove resource iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 because of JDSS resource v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] delete target: iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] delete target iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] failed to remove resource iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 because of JDSS resource iqn.2010-10.org.openstack:8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] deleating volume v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] get snapshots for volume v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] get volume v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449220', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116399', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '552288555113446256', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a0009f4f86c71299', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238296064', 'san:volume_id': 'a0009f4f86c7129911f604b5a88acbead6e97668', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90015', 'name': 'v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] delete volume:v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:29 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] volume v_8e90c124-9e5f-4a45-b3a0-79c0d934a9c3 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.quota [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Created reservations ['3609540b-76f3-4cc8-8ac9-3b6aeb8ec5c8', '453cc36a-c3d6-4baa-802c-0020b986b16f', '042d14cc-af19-4256-a1b1-d563d996b330', '17586f91-7e83-4475-8083-be746590382b'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238377984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.manager [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Deleted volume successfully. Apr 14 04:50:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-07b00530-0779-4db0-b63d-a414be22854d tempest-VolumesListAdminTestJSON-1597538331 None] Lock "cinder-8e90c124-9e5f-4a45-b3a0-79c0d934a9c3-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (e7fcb484-c627-453f-9273-6201432de9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c104c1-27da-4ad5-adf2-e909ccc1c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c104c1-27da-4ad5-adf2-e909ccc1c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-510458293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9c49c59-21e9-412f-824b-9a91e59bab6a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:35Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577f88a5-2452-4579-b0de-7876f716ec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577f88a5-2452-4579-b0de-7876f716ec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3649f8-be89-4d7f-bed5-aef01ef06349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3649f8-be89-4d7f-bed5-aef01ef06349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c49c59-21e9-412f-824b-9a91e59bab6a', 'volume_name': 'volume-b9c49c59-21e9-412f-824b-9a91e59bab6a', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a11f7a-6e7c-4ab6-965f-f1bf83ecf24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a11f7a-6e7c-4ab6-965f-f1bf83ecf24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdfc2cb-f479-4640-96d8-e0057d1233b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:35 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Volume b9c49c59-21e9-412f-824b-9a91e59bab6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c49c59-21e9-412f-824b-9a91e59bab6a', 'volume_size': 1} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] creating volume v_b9c49c59-21e9-412f-824b-9a91e59bab6a. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] create volume {'name': 'v_b9c49c59-21e9-412f-824b-9a91e59bab6a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b9c49c59-21e9-412f-824b-9a91e59bab6a', 'is_clone': False, 'name': 'v_b9c49c59-21e9-412f-824b-9a91e59bab6a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdfc2cb-f479-4640-96d8-e0057d1233b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c49c59-21e9-412f-824b-9a91e59bab6a', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3d9bd3-016a-4a7e-8ba0-28237b927d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:36 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Volume volume-b9c49c59-21e9-412f-824b-9a91e59bab6a (b9c49c59-21e9-412f-824b-9a91e59bab6a): created successfully Apr 14 04:50:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3d9bd3-016a-4a7e-8ba0-28237b927d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:36 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (e7fcb484-c627-453f-9273-6201432de9fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b0e8d6fa-01d8-4b29-b358-7c9aaff62957 tempest-VolumesGetTest-1987719640 None] Created volume successfully. Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (72fe8516-d7f6-407b-9460-7b96cd91c1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0c56ec-92ce-494a-b075-f33f5832e5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0c56ec-92ce-494a-b075-f33f5832e5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-694658992',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3711d94a-cd41-4074-b03d-0c6ee538889b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:38Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91a009e-3d3d-4547-a556-048e7f7d29fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91a009e-3d3d-4547-a556-048e7f7d29fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92ee480-6488-4372-974e-20c397ef1eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92ee480-6488-4372-974e-20c397ef1eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3711d94a-cd41-4074-b03d-0c6ee538889b', 'volume_name': 'volume-3711d94a-cd41-4074-b03d-0c6ee538889b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85def92b-cd77-4f73-a773-befe194d2042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85def92b-cd77-4f73-a773-befe194d2042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1b6f2d-0624-496b-ac12-1c7c316f84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:38 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Volume 3711d94a-cd41-4074-b03d-0c6ee538889b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3711d94a-cd41-4074-b03d-0c6ee538889b', 'volume_size': 1} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] creating volume v_3711d94a-cd41-4074-b03d-0c6ee538889b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] create volume {'name': 'v_3711d94a-cd41-4074-b03d-0c6ee538889b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=55,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3711d94a-cd41-4074-b03d-0c6ee538889b', 'is_clone': False, 'name': 'v_3711d94a-cd41-4074-b03d-0c6ee538889b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1b6f2d-0624-496b-ac12-1c7c316f84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3711d94a-cd41-4074-b03d-0c6ee538889b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d284d8a3-260e-4f36-8a43-81302122c19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:39 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Volume volume-3711d94a-cd41-4074-b03d-0c6ee538889b (3711d94a-cd41-4074-b03d-0c6ee538889b): created successfully Apr 14 04:50:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d284d8a3-260e-4f36-8a43-81302122c19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (72fe8516-d7f6-407b-9460-7b96cd91c1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:39 user cinder-volume[73393]: INFO cinder.volume.manager [None req-fe24da3c-36c5-43fb-b2b4-91c858bb9a4e tempest-VolumesGetTest-1987719640 None] Created volume successfully. Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-3711d94a-cd41-4074-b03d-0c6ee538889b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Lock "cinder-3711d94a-cd41-4074-b03d-0c6ee538889b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] remove_export for volume: 3711d94a-cd41-4074-b03d-0c6ee538889b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-510458293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3711d94a-cd41-4074-b03d-0c6ee538889b,launched_at=2023-04-14T04:50:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth='CHAP PQiNdsHR IGqaAwBYgK735T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:38Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:50:40Z,updated_at=2023-04-14T04:50:40Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] detach volume v_3711d94a-cd41-4074-b03d-0c6ee538889b from target iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b/luns/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b/luns/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b/luns/v_3711d94a-cd41-4074-b03d-0c6ee538889b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b/luns/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b because of JDSS resource v_3711d94a-cd41-4074-b03d-0c6ee538889b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] delete target: iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] delete target iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b because of JDSS resource iqn.2010-10.org.openstack:3711d94a-cd41-4074-b03d-0c6ee538889b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] deleating volume v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] get snapshots for volume v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] get volume v_3711d94a-cd41-4074-b03d-0c6ee538889b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3711d94a-cd41-4074-b03d-0c6ee538889b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449247', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116424', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9199247226190422324', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '84359f6c9bfb3fb2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238177280', 'san:volume_id': '84359f6c9bfb3fb23a6d913ec739814cb0a5d100', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90536', 'name': 'v_3711d94a-cd41-4074-b03d-0c6ee538889b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] delete volume:v_3711d94a-cd41-4074-b03d-0c6ee538889b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3711d94a-cd41-4074-b03d-0c6ee538889b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] volume v_3711d94a-cd41-4074-b03d-0c6ee538889b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:42 user cinder-volume[73393]: DEBUG cinder.quota [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Created reservations ['e2876930-e558-42a4-8c32-d35660997fe1', 'ab87ed9d-d9cb-4bff-ad12-adee90f2abaf', 'fcba548e-65a0-49a1-be02-10dc45fc0008', '23ff757c-d8e3-4581-a624-de5df389dcd9'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238271488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.manager [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:43 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Deleted volume successfully. Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5082be13-05ce-4b6d-a116-3051a19b05c3 tempest-VolumesGetTest-1987719640 None] Lock "cinder-3711d94a-cd41-4074-b03d-0c6ee538889b-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-b9c49c59-21e9-412f-824b-9a91e59bab6a-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.coordination [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Lock "cinder-b9c49c59-21e9-412f-824b-9a91e59bab6a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:DELETE=4,cinder:SELECT=59,cinder:UPDATE=32,cinder:INSERT=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] remove_export for volume: b9c49c59-21e9-412f-824b-9a91e59bab6a. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:35Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-410359930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9c49c59-21e9-412f-824b-9a91e59bab6a,launched_at=2023-04-14T04:50:37Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth='CHAP cQqRuIwg fcS7Fz1lN4ouMq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:35Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:50:44Z,updated_at=2023-04-14T04:50:44Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] detach volume v_b9c49c59-21e9-412f-824b-9a91e59bab6a from target iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a/luns/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a/luns/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a/luns/v_b9c49c59-21e9-412f-824b-9a91e59bab6a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a/luns/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a because of JDSS resource v_b9c49c59-21e9-412f-824b-9a91e59bab6a DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] delete target: iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] delete target iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a because of JDSS resource iqn.2010-10.org.openstack:b9c49c59-21e9-412f-824b-9a91e59bab6a DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] deleating volume v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] get snapshots for volume v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:43 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] get volume v_b9c49c59-21e9-412f-824b-9a91e59bab6a info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9c49c59-21e9-412f-824b-9a91e59bab6a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449244', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116420', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13611390546890672402', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8acaa1f60f352b5d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238271488', 'san:volume_id': '8acaa1f60f352b5d8790b6161885738101686aac', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90527', 'name': 'v_b9c49c59-21e9-412f-824b-9a91e59bab6a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] delete volume:v_b9c49c59-21e9-412f-824b-9a91e59bab6a recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c49c59-21e9-412f-824b-9a91e59bab6a {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] volume v_b9c49c59-21e9-412f-824b-9a91e59bab6a deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.quota [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Created reservations ['74548ec4-4b1b-472c-8c8d-2d75f0d87a46', 'febc867d-945c-4aa1-8196-af2c976a412e', '033be1e6-9008-46bd-a9e8-c3fa837aad9a', '597bf98c-8475-4032-ad08-0ceedf2291ab'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238341120', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.manager [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:46 user cinder-volume[73393]: INFO cinder.volume.manager [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Deleted volume successfully. Apr 14 04:50:46 user cinder-volume[73393]: DEBUG cinder.coordination [None req-51a5eb4d-fd5c-4270-9478-d0f251b48ae0 tempest-VolumesGetTest-1987719640 None] Lock "cinder-b9c49c59-21e9-412f-824b-9a91e59bab6a-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (19d42340-a3ad-4fe4-a930-b97010e5b187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad48cf80-3912-4bdf-859b-365b36025b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad48cf80-3912-4bdf-859b-365b36025b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1279505670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0719f2bc-f0d7-4446-9a7b-6c24f241233d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:47Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a71d7d6-8160-424f-9b6d-873676154543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a71d7d6-8160-424f-9b6d-873676154543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4745d576-d354-4398-b999-e995ee74adb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4745d576-d354-4398-b999-e995ee74adb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'volume_name': 'volume-0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d978e82-f5de-477f-9abc-f3e4c30a4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d978e82-f5de-477f-9abc-f3e4c30a4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e5cb43-83da-4ec4-a05a-2ae5c6899855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:47 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Volume 0719f2bc-f0d7-4446-9a7b-6c24f241233d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'volume_size': 1} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] creating volume v_0719f2bc-f0d7-4446-9a7b-6c24f241233d. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] create volume {'name': 'v_0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'is_clone': False, 'name': 'v_0719f2bc-f0d7-4446-9a7b-6c24f241233d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e5cb43-83da-4ec4-a05a-2ae5c6899855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ee766e-834b-4c90-a0fc-1d4adb36ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:48 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Volume volume-0719f2bc-f0d7-4446-9a7b-6c24f241233d (0719f2bc-f0d7-4446-9a7b-6c24f241233d): created successfully Apr 14 04:50:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ee766e-834b-4c90-a0fc-1d4adb36ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:48 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (19d42340-a3ad-4fe4-a930-b97010e5b187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:48 user cinder-volume[73393]: INFO cinder.volume.manager [None req-d1a0b503-b4bc-4a95-a9f3-c337534e78a1 tempest-VolumesGetTest-1987719640 None] Created volume successfully. Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (9badc960-dcb3-4339-ae3d-903c281bf19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de7c331-21d5-4633-a311-058a35cdeda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de7c331-21d5-4633-a311-058a35cdeda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-49998722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cdc4f967-58f0-439d-9c03-2eba75b5403e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0719f2bc-f0d7-4446-9a7b-6c24f241233d,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:50Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4a9edb-4856-4f95-bc7f-576e99ac13d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4a9edb-4856-4f95-bc7f-576e99ac13d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583ba3fc-c163-4de0-b2e1-a1db05c58138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583ba3fc-c163-4de0-b2e1-a1db05c58138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cdc4f967-58f0-439d-9c03-2eba75b5403e', 'volume_name': 'volume-cdc4f967-58f0-439d-9c03-2eba75b5403e', 'volume_size': 1, 'source_volid': '0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'source_volstatus': 'available'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206a1ba4-ddb3-407a-ab9a-5d6abe0abb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206a1ba4-ddb3-407a-ab9a-5d6abe0abb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871cef1d-2169-4a48-a85f-596e1888b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:49 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Volume cdc4f967-58f0-439d-9c03-2eba75b5403e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cdc4f967-58f0-439d-9c03-2eba75b5403e', 'volume_size': 1, 'source_volid': '0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'source_volstatus': 'available'} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] cloned volume 0719f2bc-f0d7-4446-9a7b-6c24f241233d to cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] cloning v_0719f2bc-f0d7-4446-9a7b-6c24f241233d to v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] create snapshot v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_cdc4f967-58f0-439d-9c03-2eba75b5403e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] create volume v_cdc4f967-58f0-439d-9c03-2eba75b5403e from snapshot v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:50:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d@v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'is_clone': True, 'full_name': 'Pool-0/v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'name': 'v_cdc4f967-58f0-439d-9c03-2eba75b5403e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] get volume v_cdc4f967-58f0-439d-9c03-2eba75b5403e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d@v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449259', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116436', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5856383018423697565', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '25766de4e3c624e4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238259200', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90642', 'name': 'v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871cef1d-2169-4a48-a85f-596e1888b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc4f967-58f0-439d-9c03-2eba75b5403e', 'volume_size': 1, 'source_volid': '0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'source_volstatus': 'available'}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa853c3e-190d-4515-bc18-0c91013eb353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:51 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Volume volume-cdc4f967-58f0-439d-9c03-2eba75b5403e (cdc4f967-58f0-439d-9c03-2eba75b5403e): created successfully Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa853c3e-190d-4515-bc18-0c91013eb353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:51 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (9badc960-dcb3-4339-ae3d-903c281bf19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:51 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2423b101-ff9a-4532-bd65-d524cbcc17d1 tempest-VolumesGetTest-1987719640 None] Created volume successfully. Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (8f55963c-192b-4687-8a9c-e557963dbbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e653c89-dc19-42c6-a750-275ddf763968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e653c89-dc19-42c6-a750-275ddf763968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-946173943',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7e7c6cc3-9e40-4c6a-9747-a35769517656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:50:53Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b538f35-9897-46a0-ac7f-a565be518915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b538f35-9897-46a0-ac7f-a565be518915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494063c9-7b20-44d1-81d3-1a1d7e11e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494063c9-7b20-44d1-81d3-1a1d7e11e409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7c6cc3-9e40-4c6a-9747-a35769517656', 'volume_name': 'volume-7e7c6cc3-9e40-4c6a-9747-a35769517656', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e81357d-f3bd-4f19-94bc-72af8f9ee473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e81357d-f3bd-4f19-94bc-72af8f9ee473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544d0263-82f7-4372-81fc-67aa8db4d892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:53 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Volume 7e7c6cc3-9e40-4c6a-9747-a35769517656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7c6cc3-9e40-4c6a-9747-a35769517656', 'volume_size': 1} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] creating volume v_7e7c6cc3-9e40-4c6a-9747-a35769517656. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] create volume {'name': 'v_7e7c6cc3-9e40-4c6a-9747-a35769517656', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7e7c6cc3-9e40-4c6a-9747-a35769517656', 'is_clone': False, 'name': 'v_7e7c6cc3-9e40-4c6a-9747-a35769517656'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544d0263-82f7-4372-81fc-67aa8db4d892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7c6cc3-9e40-4c6a-9747-a35769517656', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff294294-c9c4-4a84-b1a9-ea5fff7be12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:50:54 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Volume volume-7e7c6cc3-9e40-4c6a-9747-a35769517656 (7e7c6cc3-9e40-4c6a-9747-a35769517656): created successfully Apr 14 04:50:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff294294-c9c4-4a84-b1a9-ea5fff7be12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:50:54 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (8f55963c-192b-4687-8a9c-e557963dbbc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:50:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-be52dc8b-aff4-4906-b881-c476dfc23d61 tempest-VolumesGetTest-1987719640 None] Created volume successfully. Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.coordination [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-7e7c6cc3-9e40-4c6a-9747-a35769517656-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.coordination [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Lock "cinder-7e7c6cc3-9e40-4c6a-9747-a35769517656-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] remove_export for volume: 7e7c6cc3-9e40-4c6a-9747-a35769517656. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-49998722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7e7c6cc3-9e40-4c6a-9747-a35769517656,launched_at=2023-04-14T04:50:54Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth='CHAP xsjDzQSk a8PYAoWecn6Gmw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:53Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:50:56Z,updated_at=2023-04-14T04:50:56Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] detach volume v_7e7c6cc3-9e40-4c6a-9747-a35769517656 from target iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656/luns/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656/luns/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656/luns/v_7e7c6cc3-9e40-4c6a-9747-a35769517656'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656/luns/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 because of JDSS resource v_7e7c6cc3-9e40-4c6a-9747-a35769517656 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] delete target: iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] delete target iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 because of JDSS resource iqn.2010-10.org.openstack:7e7c6cc3-9e40-4c6a-9747-a35769517656 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] deleating volume v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] get snapshots for volume v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] get volume v_7e7c6cc3-9e40-4c6a-9747-a35769517656 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7e7c6cc3-9e40-4c6a-9747-a35769517656', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449262', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116440', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15059598766130506761', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0dabc2b387e17fe2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238164992', 'san:volume_id': '0dabc2b387e17fe2bccc56bb8705b49458feffc9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90654', 'name': 'v_7e7c6cc3-9e40-4c6a-9747-a35769517656', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] delete volume:v_7e7c6cc3-9e40-4c6a-9747-a35769517656 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e7c6cc3-9e40-4c6a-9747-a35769517656 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] volume v_7e7c6cc3-9e40-4c6a-9747-a35769517656 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.quota [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Created reservations ['643419db-a84e-4c2a-831b-4e30f395c8be', '0a01c114-91b6-4d1b-9961-0af11e1ae2f6', '59395c48-a0da-4eaa-85d1-cf1a1e8e0c64', 'e8221005-67be-4fda-af5e-7d3a650ca155'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-cdc4f967-58f0-439d-9c03-2eba75b5403e-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Lock "cinder-cdc4f967-58f0-439d-9c03-2eba75b5403e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] remove_export for volume: cdc4f967-58f0-439d-9c03-2eba75b5403e. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:49Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-1276302193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cdc4f967-58f0-439d-9c03-2eba75b5403e,launched_at=2023-04-14T04:50:52Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth='CHAP yvpRWScB l4y1wAGfaQ0YgD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:50Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0719f2bc-f0d7-4446-9a7b-6c24f241233d,status='deleting',terminated_at=2023-04-14T04:50:59Z,updated_at=2023-04-14T04:50:59Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] detach volume v_cdc4f967-58f0-439d-9c03-2eba75b5403e from target iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e/luns/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e/luns/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238234624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.manager [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:50:58 user cinder-volume[73393]: INFO cinder.volume.manager [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Deleted volume successfully. Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.coordination [None req-adaea165-84f6-49ea-a1c2-fe1265c7d975 tempest-VolumesGetTest-1987719640 None] Lock "cinder-7e7c6cc3-9e40-4c6a-9747-a35769517656-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e/luns/v_cdc4f967-58f0-439d-9c03-2eba75b5403e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e/luns/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e because of JDSS resource v_cdc4f967-58f0-439d-9c03-2eba75b5403e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] delete target: iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] delete target iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e because of JDSS resource iqn.2010-10.org.openstack:cdc4f967-58f0-439d-9c03-2eba75b5403e DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] deleating volume v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] get snapshots for volume v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:58 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] get volume v_cdc4f967-58f0-439d-9c03-2eba75b5403e info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d@v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449259', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116436', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5856383018423697565', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '25766de4e3c624e4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238234624', 'san:volume_id': '25766de4e3c624e4fffbe251b0ff14b8e172c703', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90642', 'name': 'v_cdc4f967-58f0-439d-9c03-2eba75b5403e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] delete snapshot v_cdc4f967-58f0-439d-9c03-2eba75b5403e of volume v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:50:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots/v_cdc4f967-58f0-439d-9c03-2eba75b5403e {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] snapshot v_cdc4f967-58f0-439d-9c03-2eba75b5403e deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.quota [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Created reservations ['34f91dd6-8dc3-47e2-820c-20e069902fa5', 'be0ee8f7-fa2c-4db1-9500-1999f48d6263', 'abc7d9f3-1bce-44ea-aaf2-2d083748587e', '6c01feee-e708-49bd-92be-6b266e586eeb'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238246912', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.manager [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:51:01 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Deleted volume successfully. Apr 14 04:51:01 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ffb975b4-039d-4d56-a4f5-006757c18fd5 tempest-VolumesGetTest-1987719640 None] Lock "cinder-cdc4f967-58f0-439d-9c03-2eba75b5403e-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-0719f2bc-f0d7-4446-9a7b-6c24f241233d-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.coordination [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Lock "cinder-0719f2bc-f0d7-4446-9a7b-6c24f241233d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] remove_export for volume: 0719f2bc-f0d7-4446-9a7b-6c24f241233d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1279505670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0719f2bc-f0d7-4446-9a7b-6c24f241233d,launched_at=2023-04-14T04:50:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth='CHAP MaUBZFvV 0CeDFUKYjBHdLT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:50:47Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:51:02Z,updated_at=2023-04-14T04:51:02Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] detach volume v_0719f2bc-f0d7-4446-9a7b-6c24f241233d from target iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d/luns/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d/luns/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d/luns/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d/luns/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d because of JDSS resource v_0719f2bc-f0d7-4446-9a7b-6c24f241233d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] delete target: iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] delete target iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d because of JDSS resource iqn.2010-10.org.openstack:0719f2bc-f0d7-4446-9a7b-6c24f241233d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] deleating volume v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] get snapshots for volume v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] get volume v_0719f2bc-f0d7-4446-9a7b-6c24f241233d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449256', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116430', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11028890901265587729', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '870aefddb43a3415', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238246912', 'san:volume_id': '870aefddb43a34154da2e46b25fa164ad6d9346f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90549', 'name': 'v_0719f2bc-f0d7-4446-9a7b-6c24f241233d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] delete volume:v_0719f2bc-f0d7-4446-9a7b-6c24f241233d recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0719f2bc-f0d7-4446-9a7b-6c24f241233d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] volume v_0719f2bc-f0d7-4446-9a7b-6c24f241233d deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG cinder.quota [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Created reservations ['66d28192-ce9a-4124-89a5-46bcdde7efe6', '13e594f0-f0b3-4a39-8256-0cf442803ab7', 'c9b8e0db-c938-4d06-a621-376b968c8c0d', 'ce682bf6-bd6b-4f9c-964e-404a98bf92ff'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=56,cinder:INSERT=7,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238341120', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.manager [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:51:05 user cinder-volume[73393]: INFO cinder.volume.manager [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Deleted volume successfully. Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-915a35f6-4d83-4f77-9626-8c7012ba42ba tempest-VolumesGetTest-1987719640 None] Lock "cinder-0719f2bc-f0d7-4446-9a7b-6c24f241233d-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (7561c3ee-036b-4ec3-8d00-c49b390535eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc584ce-dc25-4b79-9f97-c61178a95275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc584ce-dc25-4b79-9f97-c61178a95275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-242262842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6784366b-4f54-48df-b79d-8552accdaf9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:51:06Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e418f8-2bda-4b60-aafe-8ca6c93fc0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e418f8-2bda-4b60-aafe-8ca6c93fc0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f78c69f-28de-4caf-8bc3-9738be768a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f78c69f-28de-4caf-8bc3-9738be768a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6784366b-4f54-48df-b79d-8552accdaf9d', 'volume_name': 'volume-6784366b-4f54-48df-b79d-8552accdaf9d', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb0f9cc-7588-4786-97eb-e6d2f93df0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb0f9cc-7588-4786-97eb-e6d2f93df0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf34dd20-2bb3-4db6-be86-549eead52b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:05 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Volume 6784366b-4f54-48df-b79d-8552accdaf9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6784366b-4f54-48df-b79d-8552accdaf9d', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Cloning 6784366b-4f54-48df-b79d-8552accdaf9d from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 at location (None, None). {{(pid=73393) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 04:51:05 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" by "_prepare_image_cache_entry" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 51, 6, 11335)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Found cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.coordination [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Lock "cinder-5c55a1da-f6f8-4442-939b-f0cb72ea4327" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Attempting to retrieve cache entry for image = 5c55a1da-f6f8-4442-939b-f0cb72ea4327 on host user@joviandss-2#joviandss-2. {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Found image-volume cache entry: {'id': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'volume_id': 'b0a9c0c1-47b3-429b-99b9-c9a847b4891f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48), 'last_used': datetime.datetime(2023, 4, 14, 4, 51, 6, 27183)}. {{(pid=73393) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.image.cache [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Image-volume cache entry image_update_at = 2023-04-14 04:12:48+00:00, requested image updated_at = 2023-04-14 04:12:48+00:00. {{(pid=73393) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Creating from source image-volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] cloned volume b0a9c0c1-47b3-429b-99b9-c9a847b4891f to 6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] cloning v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f to v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] create snapshot v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_6784366b-4f54-48df-b79d-8552accdaf9d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] create volume v_6784366b-4f54-48df-b79d-8552accdaf9d from snapshot v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:51:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_6784366b-4f54-48df-b79d-8552accdaf9d', 'is_clone': True, 'full_name': 'Pool-0/v_6784366b-4f54-48df-b79d-8552accdaf9d', 'name': 'v_6784366b-4f54-48df-b79d-8552accdaf9d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] get volume v_6784366b-4f54-48df-b79d-8552accdaf9d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_6784366b-4f54-48df-b79d-8552accdaf9d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6784366b-4f54-48df-b79d-8552accdaf9d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449276', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '116451', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11425517154198118888', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cefa735fad8cca92', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238304256', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90668', 'name': 'v_6784366b-4f54-48df-b79d-8552accdaf9d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.volume_utils [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Marking volume 6784366b-4f54-48df-b79d-8552accdaf9d as bootable. {{(pid=73393) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Copying metadata from image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 to 6784366b-4f54-48df-b79d-8552accdaf9d. {{(pid=73393) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Creating volume glance metadata for volume 6784366b-4f54-48df-b79d-8552accdaf9d backed by image 5c55a1da-f6f8-4442-939b-f0cb72ea4327 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73393) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf34dd20-2bb3-4db6-be86-549eead52b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6784366b-4f54-48df-b79d-8552accdaf9d', 'volume_size': 1, 'image_id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8b3c3fd68cb4219826c2a6fd8b21939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'created_at': datetime.datetime(2023, 4, 14, 4, 12, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 4, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c55a1da-f6f8-4442-939b-f0cb72ea4327/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18b4e02-252f-4b86-8022-e1cf271cf970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:08 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Volume volume-6784366b-4f54-48df-b79d-8552accdaf9d (6784366b-4f54-48df-b79d-8552accdaf9d): created successfully Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18b4e02-252f-4b86-8022-e1cf271cf970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (7561c3ee-036b-4ec3-8d00-c49b390535eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:08 user cinder-volume[73393]: INFO cinder.volume.manager [None req-cb82ec76-669a-478b-b5d4-83e785bde791 tempest-VolumesGetTest-1987719640 None] Created volume successfully. Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (d475102a-f5c8-481b-b79b-6ec8e3348444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c7d003-572a-4ea1-8b03-ac5617e4f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c7d003-572a-4ea1-8b03-ac5617e4f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2026383591',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d9127619-ffba-41a2-b15b-f4aba5ffc130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:51:09Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786416ae-39f7-4317-ad41-88f326627fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786416ae-39f7-4317-ad41-88f326627fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8c49b4-2065-47cf-8a8d-ac55580a8fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8c49b4-2065-47cf-8a8d-ac55580a8fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9127619-ffba-41a2-b15b-f4aba5ffc130', 'volume_name': 'volume-d9127619-ffba-41a2-b15b-f4aba5ffc130', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851f233-1980-47b8-8685-e05a4038dacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851f233-1980-47b8-8685-e05a4038dacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c0956f-df7e-47be-bc4d-2cb9f90a9fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:09 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Volume d9127619-ffba-41a2-b15b-f4aba5ffc130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9127619-ffba-41a2-b15b-f4aba5ffc130', 'volume_size': 1} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] creating volume v_d9127619-ffba-41a2-b15b-f4aba5ffc130. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] create volume {'name': 'v_d9127619-ffba-41a2-b15b-f4aba5ffc130', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:09 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:10 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d9127619-ffba-41a2-b15b-f4aba5ffc130', 'is_clone': False, 'name': 'v_d9127619-ffba-41a2-b15b-f4aba5ffc130'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c0956f-df7e-47be-bc4d-2cb9f90a9fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9127619-ffba-41a2-b15b-f4aba5ffc130', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03acc482-0ef3-4747-8924-0e4aa3199a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:10 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Volume volume-d9127619-ffba-41a2-b15b-f4aba5ffc130 (d9127619-ffba-41a2-b15b-f4aba5ffc130): created successfully Apr 14 04:51:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03acc482-0ef3-4747-8924-0e4aa3199a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:10 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Flow 'volume_create_manager' (d475102a-f5c8-481b-b79b-6ec8e3348444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:10 user cinder-volume[73393]: INFO cinder.volume.manager [None req-c0f8150e-90ad-4f61-9945-ba67f2f04ae3 tempest-VolumesGetTest-1987719640 None] Created volume successfully. Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-d9127619-ffba-41a2-b15b-f4aba5ffc130-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Lock "cinder-d9127619-ffba-41a2-b15b-f4aba5ffc130-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] remove_export for volume: d9127619-ffba-41a2-b15b-f4aba5ffc130. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-242262842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d9127619-ffba-41a2-b15b-f4aba5ffc130,launched_at=2023-04-14T04:51:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth='CHAP XAOqYsjb 8LoFEx5SD1bqPu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:09Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:51:12Z,updated_at=2023-04-14T04:51:12Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] detach volume v_d9127619-ffba-41a2-b15b-f4aba5ffc130 from target iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130/luns/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130/luns/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130/luns/v_d9127619-ffba-41a2-b15b-f4aba5ffc130'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130/luns/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 because of JDSS resource v_d9127619-ffba-41a2-b15b-f4aba5ffc130 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] delete target: iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] delete target iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 because of JDSS resource iqn.2010-10.org.openstack:d9127619-ffba-41a2-b15b-f4aba5ffc130 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] deleating volume v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] get snapshots for volume v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:11 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] get volume v_d9127619-ffba-41a2-b15b-f4aba5ffc130 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d9127619-ffba-41a2-b15b-f4aba5ffc130', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449278', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116455', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13407117224060897480', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c17fd3c6152c292d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238222336', 'san:volume_id': 'c17fd3c6152c292d57647335d9d8ce6d97cd5fa9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90679', 'name': 'v_d9127619-ffba-41a2-b15b-f4aba5ffc130', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] delete volume:v_d9127619-ffba-41a2-b15b-f4aba5ffc130 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:12 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Flow 'volume_create_manager' (ac01d801-5d8f-451d-82c7-cc0ae8f95629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc03c279-36f3-4d25-85e2-12c5c24bbd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc03c279-36f3-4d25-85e2-12c5c24bbd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-821968297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4373e616-f91b-4891-aa6c-750892ae43b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10c8cf348e04e44afbaae93a4b60e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:51:13Z,use_quota=True,user_id='67d6c699fc524554a6f4983af91d58fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d104cfd-396e-43bb-b424-5ebc78dfc28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d104cfd-396e-43bb-b424-5ebc78dfc28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd35fdb-ebcb-4d42-a109-65bb48a1e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd35fdb-ebcb-4d42-a109-65bb48a1e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4373e616-f91b-4891-aa6c-750892ae43b5', 'volume_name': 'volume-4373e616-f91b-4891-aa6c-750892ae43b5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85880f-d54b-4c27-9ea8-925e1d2af2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85880f-d54b-4c27-9ea8-925e1d2af2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4824d0-dc6a-409b-8b60-c8e5120601e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:13 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Volume 4373e616-f91b-4891-aa6c-750892ae43b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4373e616-f91b-4891-aa6c-750892ae43b5', 'volume_size': 1} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] creating volume v_4373e616-f91b-4891-aa6c-750892ae43b5. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] create volume {'name': 'v_4373e616-f91b-4891-aa6c-750892ae43b5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:13 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9127619-ffba-41a2-b15b-f4aba5ffc130 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] volume v_d9127619-ffba-41a2-b15b-f4aba5ffc130 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.quota [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Created reservations ['0a9954ef-d8cd-4e1e-b1ee-75b12ce8fe85', '8463f91b-a3a3-41a6-bb96-f8900e6377a4', '13a4ffc2-3dc6-4b5e-b25a-b7805cb301ef', 'df7561bd-b342-444c-b217-0ea6c7ff2676'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=59,cinder:INSERT=11,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4373e616-f91b-4891-aa6c-750892ae43b5', 'is_clone': False, 'name': 'v_4373e616-f91b-4891-aa6c-750892ae43b5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4824d0-dc6a-409b-8b60-c8e5120601e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4373e616-f91b-4891-aa6c-750892ae43b5', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d645c71-9a7f-4fb6-be3e-9d4711ebb049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:14 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Volume volume-4373e616-f91b-4891-aa6c-750892ae43b5 (4373e616-f91b-4891-aa6c-750892ae43b5): created successfully Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d645c71-9a7f-4fb6-be3e-9d4711ebb049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Flow 'volume_create_manager' (ac01d801-5d8f-451d-82c7-cc0ae8f95629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-0d849dd4-eaae-4f14-b583-6044f75a1170 tempest-AttachVolumeShelveTestJSON-2141578557 None] Created volume successfully. Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238210048', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.manager [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:51:14 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Deleted volume successfully. Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-f28f5330-d216-4d72-959b-ba8c71ac76fa tempest-VolumesGetTest-1987719640 None] Lock "cinder-d9127619-ffba-41a2-b15b-f4aba5ffc130-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Acquiring lock "cinder-6784366b-4f54-48df-b79d-8552accdaf9d-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.coordination [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Lock "cinder-6784366b-4f54-48df-b79d-8552accdaf9d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] remove_export for volume: 6784366b-4f54-48df-b79d-8552accdaf9d. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:06Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-21797695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6784366b-4f54-48df-b79d-8552accdaf9d,launched_at=2023-04-14T04:51:08Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0fc70731543759c5f50bbb9d6c1a2',provider_auth='CHAP KWjsLSRQ pNzhiTZ3bvAsng',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:06Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:51:15Z,updated_at=2023-04-14T04:51:15Z,use_quota=True,user_id='f5ce341869184a02af35f2452b1d861d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] detach volume v_6784366b-4f54-48df-b79d-8552accdaf9d from target iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d/luns/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d/luns/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d/luns/v_6784366b-4f54-48df-b79d-8552accdaf9d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d/luns/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d because of JDSS resource v_6784366b-4f54-48df-b79d-8552accdaf9d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] delete target: iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] delete target iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:14 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] failed to remove resource iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d because of JDSS resource iqn.2010-10.org.openstack:6784366b-4f54-48df-b79d-8552accdaf9d DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] deleating volume v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] get snapshots for volume v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] get volume v_6784366b-4f54-48df-b79d-8552accdaf9d info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f@v_6784366b-4f54-48df-b79d-8552accdaf9d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6784366b-4f54-48df-b79d-8552accdaf9d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449276', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '116451', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11425517154198118888', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cefa735fad8cca92', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238222336', 'san:volume_id': 'cefa735fad8cca92b7a684d0127fccd2294e4f63', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90668', 'name': 'v_6784366b-4f54-48df-b79d-8552accdaf9d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] delete snapshot v_6784366b-4f54-48df-b79d-8552accdaf9d of volume v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b0a9c0c1-47b3-429b-99b9-c9a847b4891f/snapshots/v_6784366b-4f54-48df-b79d-8552accdaf9d {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] snapshot v_6784366b-4f54-48df-b79d-8552accdaf9d deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:51:17 user cinder-volume[73393]: DEBUG cinder.quota [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Created reservations ['18371f89-ef37-4a39-b192-954f169d2f38', '797948ed-98d5-4d20-b4de-2c011735d3b0', '7a59d110-cbc2-4463-b6ae-a84f2396c100', 'dade09f9-bcbb-4b80-bb45-f3e125262b04'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:51:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:51:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:51:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238234624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:51:18 user cinder-volume[73393]: DEBUG cinder.manager [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:51:18 user cinder-volume[73393]: INFO cinder.volume.manager [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Deleted volume successfully. Apr 14 04:51:18 user cinder-volume[73393]: DEBUG cinder.coordination [None req-70983d0c-295a-4e94-84ce-ef4387d7e0f2 tempest-VolumesGetTest-1987719640 None] Lock "cinder-6784366b-4f54-48df-b79d-8552accdaf9d-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Flow 'volume_create_manager' (8ce56df8-8c8f-4a02-8d6c-aeec7d4a82a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cbb329-ad40-4caf-beb2-6de271dd0b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cbb329-ad40-4caf-beb2-6de271dd0b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=233be5bb-4d75-4e96-ae42-01fba62ec325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab41cd8139b5452d89c96e1302bb65e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:51:20Z,use_quota=True,user_id='ea5a962d877249f998c72d0fc6a330ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b0b80-0a35-49bf-9eae-191063d5832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b0b80-0a35-49bf-9eae-191063d5832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9951ad8-135b-4b90-99d2-35a0144fba22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9951ad8-135b-4b90-99d2-35a0144fba22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233be5bb-4d75-4e96-ae42-01fba62ec325', 'volume_name': 'volume-233be5bb-4d75-4e96-ae42-01fba62ec325', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83683483-0364-4c9b-8d3b-496df6c25b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83683483-0364-4c9b-8d3b-496df6c25b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa0d53c-f4d8-4e97-adfe-7386a9b53f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:20 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Volume 233be5bb-4d75-4e96-ae42-01fba62ec325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233be5bb-4d75-4e96-ae42-01fba62ec325', 'volume_size': 1} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] creating volume v_233be5bb-4d75-4e96-ae42-01fba62ec325. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] create volume {'name': 'v_233be5bb-4d75-4e96-ae42-01fba62ec325', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_233be5bb-4d75-4e96-ae42-01fba62ec325', 'is_clone': False, 'name': 'v_233be5bb-4d75-4e96-ae42-01fba62ec325'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:21 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:UPDATE=29,cinder:INSERT=12,cinder:DELETE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa0d53c-f4d8-4e97-adfe-7386a9b53f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233be5bb-4d75-4e96-ae42-01fba62ec325', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6338d45f-b103-4630-869f-354ca3af4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:21 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Volume volume-233be5bb-4d75-4e96-ae42-01fba62ec325 (233be5bb-4d75-4e96-ae42-01fba62ec325): created successfully Apr 14 04:51:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6338d45f-b103-4630-869f-354ca3af4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:21 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Flow 'volume_create_manager' (8ce56df8-8c8f-4a02-8d6c-aeec7d4a82a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:21 user cinder-volume[73393]: INFO cinder.volume.manager [None req-37e993f8-ea54-4820-baac-990d4540e869 tempest-CinderUnicodeTest-2116933862 None] Created volume successfully. Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Flow 'volume_create_manager' (dd1c517d-0a1d-489a-af64-7c267af01928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e69ed-76e1-4f48-8528-cdeb8380808e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e69ed-76e1-4f48-8528-cdeb8380808e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-974696169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=737e4007-f67e-42e2-92ee-e3c70d007765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab41cd8139b5452d89c96e1302bb65e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:51:23Z,use_quota=True,user_id='ea5a962d877249f998c72d0fc6a330ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c50185b-45f8-4f1c-939f-4a0a9ff35579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c50185b-45f8-4f1c-939f-4a0a9ff35579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b758d921-3129-4005-984c-97bb6c68f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b758d921-3129-4005-984c-97bb6c68f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '737e4007-f67e-42e2-92ee-e3c70d007765', 'volume_name': 'volume-737e4007-f67e-42e2-92ee-e3c70d007765', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be39f87-694e-42d5-88f1-1810585bf255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be39f87-694e-42d5-88f1-1810585bf255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2bd955-e6cc-4ca1-8e7d-aec8285ab4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:22 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Volume 737e4007-f67e-42e2-92ee-e3c70d007765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-737e4007-f67e-42e2-92ee-e3c70d007765', 'volume_size': 1} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] creating volume v_737e4007-f67e-42e2-92ee-e3c70d007765. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] create volume {'name': 'v_737e4007-f67e-42e2-92ee-e3c70d007765', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_737e4007-f67e-42e2-92ee-e3c70d007765', 'is_clone': False, 'name': 'v_737e4007-f67e-42e2-92ee-e3c70d007765'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2bd955-e6cc-4ca1-8e7d-aec8285ab4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-737e4007-f67e-42e2-92ee-e3c70d007765', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2c780d-1667-49de-99bf-baf6aeb73849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:51:23 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Volume volume-737e4007-f67e-42e2-92ee-e3c70d007765 (737e4007-f67e-42e2-92ee-e3c70d007765): created successfully Apr 14 04:51:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2c780d-1667-49de-99bf-baf6aeb73849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:51:23 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Flow 'volume_create_manager' (dd1c517d-0a1d-489a-af64-7c267af01928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:51:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1e7b77b1-a8e4-44ca-bfa7-f9370160cb67 tempest-CinderUnicodeTest-2116933862 None] Created volume successfully. Apr 14 04:51:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] create snapshot f6faaa39-36c9-4f3d-8c48-893773138be7 for volume 737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] cloning v_737e4007-f67e-42e2-92ee-e3c70d007765 to s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] create snapshot s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238058496', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:51:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:51:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f6faaa39-36c9-4f3d-8c48-893773138be7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] create volume s_f6faaa39-36c9-4f3d-8c48-893773138be7 from snapshot s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:51:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:26 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_737e4007-f67e-42e2-92ee-e3c70d007765@s_f6faaa39-36c9-4f3d-8c48-893773138be7', 'is_clone': True, 'full_name': 'Pool-0/s_f6faaa39-36c9-4f3d-8c48-893773138be7', 'name': 's_f6faaa39-36c9-4f3d-8c48-893773138be7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] volume s_f6faaa39-36c9-4f3d-8c48-893773138be7 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:51:27 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5ca7e6d8-4705-40ca-b41f-e06cb5274081 tempest-CinderUnicodeTest-2116933862 None] Create snapshot completed successfully Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Acquiring lock "cinder-f6faaa39-36c9-4f3d-8c48-893773138be7-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Lock "cinder-f6faaa39-36c9-4f3d-8c48-893773138be7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] deleating snapshot s_f6faaa39-36c9-4f3d-8c48-893773138be7. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] get snapshots for volume s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] get volume s_f6faaa39-36c9-4f3d-8c48-893773138be7 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_737e4007-f67e-42e2-92ee-e3c70d007765@s_f6faaa39-36c9-4f3d-8c48-893773138be7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f6faaa39-36c9-4f3d-8c48-893773138be7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449295', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116477', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17754607933735259370', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4f77030579f180c1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237972480', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '89924', 'name': 's_f6faaa39-36c9-4f3d-8c48-893773138be7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] delete snapshot s_f6faaa39-36c9-4f3d-8c48-893773138be7 of volume v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots/s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots/s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots/s_f6faaa39-36c9-4f3d-8c48-893773138be7 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] snapshot s_f6faaa39-36c9-4f3d-8c48-893773138be7 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:51:30 user cinder-volume[73393]: DEBUG cinder.quota [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Created reservations ['9e26fef2-d7d8-48f6-914f-66148323ba6e', 'd06e138d-fbfd-4f24-8f7f-3b6e4163f71c', 'fed0982a-f938-4231-b0bf-221a0a5e495d', '9c08b660-700d-4080-be4b-6a0ac04c25b2'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:51:30 user cinder-volume[73393]: INFO cinder.volume.manager [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Delete snapshot completed successfully. Apr 14 04:51:30 user cinder-volume[73393]: DEBUG cinder.coordination [None req-acb05ad1-d91d-42b6-a873-ab24c96d0dd9 tempest-CinderUnicodeTest-2116933862 None] Lock "cinder-f6faaa39-36c9-4f3d-8c48-893773138be7-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Acquiring lock "cinder-737e4007-f67e-42e2-92ee-e3c70d007765-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Lock "cinder-737e4007-f67e-42e2-92ee-e3c70d007765-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] remove_export for volume: 737e4007-f67e-42e2-92ee-e3c70d007765. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-974696169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=737e4007-f67e-42e2-92ee-e3c70d007765,launched_at=2023-04-14T04:51:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab41cd8139b5452d89c96e1302bb65e0',provider_auth='CHAP JymYzKnf 8ziRq1LZbIexsF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:23Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:51:31Z,updated_at=2023-04-14T04:51:31Z,use_quota=True,user_id='ea5a962d877249f998c72d0fc6a330ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] detach volume v_737e4007-f67e-42e2-92ee-e3c70d007765 from target iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765/luns/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765/luns/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765/luns/v_737e4007-f67e-42e2-92ee-e3c70d007765'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765/luns/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] failed to remove resource iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 because of JDSS resource v_737e4007-f67e-42e2-92ee-e3c70d007765 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] delete target: iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] delete target iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] failed to remove resource iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 because of JDSS resource iqn.2010-10.org.openstack:737e4007-f67e-42e2-92ee-e3c70d007765 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] deleating volume v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] get snapshots for volume v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] get volume v_737e4007-f67e-42e2-92ee-e3c70d007765 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_737e4007-f67e-42e2-92ee-e3c70d007765', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449291', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116471', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17491043765829874311', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'aa85f33b49418b4b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237997056', 'san:volume_id': 'aa85f33b49418b4b77c0af7468268245aaa4e427', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90439', 'name': 'v_737e4007-f67e-42e2-92ee-e3c70d007765', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] delete volume:v_737e4007-f67e-42e2-92ee-e3c70d007765 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_737e4007-f67e-42e2-92ee-e3c70d007765 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] volume v_737e4007-f67e-42e2-92ee-e3c70d007765 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:51:33 user cinder-volume[73393]: DEBUG cinder.quota [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Created reservations ['c4a2e2eb-0ee3-4310-afc7-c1558de2ebb0', 'c8e52614-54d7-4e99-9f51-2ddf621e3043', 'c0472570-7ed4-4f75-8bb2-2d71b6e5074b', 'cd1b948c-dd6b-43fe-a178-f4e7f7a48355'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:51:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:51:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:51:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238066688', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.manager [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:51:34 user cinder-volume[73393]: INFO cinder.volume.manager [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Deleted volume successfully. Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.coordination [None req-ed13d2df-beed-4a18-bd75-54b3f1682cf6 tempest-CinderUnicodeTest-2116933862 None] Lock "cinder-737e4007-f67e-42e2-92ee-e3c70d007765-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Acquiring lock "cinder-233be5bb-4d75-4e96-ae42-01fba62ec325-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Lock "cinder-233be5bb-4d75-4e96-ae42-01fba62ec325-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] remove_export for volume: 233be5bb-4d75-4e96-ae42-01fba62ec325. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=233be5bb-4d75-4e96-ae42-01fba62ec325,launched_at=2023-04-14T04:51:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab41cd8139b5452d89c96e1302bb65e0',provider_auth='CHAP crFhJXef QluDc8HaAkVZEb',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:20Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:51:34Z,updated_at=2023-04-14T04:51:34Z,use_quota=True,user_id='ea5a962d877249f998c72d0fc6a330ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] detach volume v_233be5bb-4d75-4e96-ae42-01fba62ec325 from target iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325/luns/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325/luns/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325/luns/v_233be5bb-4d75-4e96-ae42-01fba62ec325'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325/luns/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] failed to remove resource iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 because of JDSS resource v_233be5bb-4d75-4e96-ae42-01fba62ec325 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] delete target: iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] delete target iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] failed to remove resource iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 because of JDSS resource iqn.2010-10.org.openstack:233be5bb-4d75-4e96-ae42-01fba62ec325 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] deleating volume v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] get snapshots for volume v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:34 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] get volume v_233be5bb-4d75-4e96-ae42-01fba62ec325 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_233be5bb-4d75-4e96-ae42-01fba62ec325', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449289', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116467', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17226197609659204612', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e42bf58124edcc81', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238066688', 'san:volume_id': 'e42bf58124edcc81e2941514e4b0b55598e800f5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90432', 'name': 'v_233be5bb-4d75-4e96-ae42-01fba62ec325', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] delete volume:v_233be5bb-4d75-4e96-ae42-01fba62ec325 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_233be5bb-4d75-4e96-ae42-01fba62ec325 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] volume v_233be5bb-4d75-4e96-ae42-01fba62ec325 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.quota [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Created reservations ['37485daf-c697-42c2-9671-d739c80007f9', '9369d19f-a1d0-4894-be12-8f48442c8e2e', '35f22b2a-2031-4e4e-a3f5-df11b2f54418', '03464197-9e11-4c45-8fac-3c748e644c15'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238148608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.manager [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:51:37 user cinder-volume[73393]: INFO cinder.volume.manager [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Deleted volume successfully. Apr 14 04:51:37 user cinder-volume[73393]: DEBUG cinder.coordination [None req-bec90aa1-a7e6-4e05-8cea-26306a1b9943 tempest-CinderUnicodeTest-2116933862 None] Lock "cinder-233be5bb-4d75-4e96-ae42-01fba62ec325-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:51:58 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=50,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=6 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:52:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:INSERT=2,cinder:SELECT=10,cinder:UPDATE=14 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:52:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:52:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:52:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:52:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:52:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:52:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238148608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:52:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:52:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:52:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:52:48 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 req-da78ce13-31c8-46ea-a291-ae2535dd02ce tempest-AttachVolumeShelveTestJSON-2141578557 None] No connector for attachment abd5072c-1274-4b41-b073-4ccf4b4ee4be; skipping storage backend terminate_connection call. {{(pid=73393) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4961}} Apr 14 04:53:08 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 req-da78ce13-31c8-46ea-a291-ae2535dd02ce tempest-AttachVolumeShelveTestJSON-2141578557 None] Deleting attachment abd5072c-1274-4b41-b073-4ccf4b4ee4be. {{(pid=73393) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 04:53:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:53:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:53:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:53:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:53:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:53:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238148608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:53:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:53:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:53:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:48 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:54:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:54:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:54:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:54:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:54:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238148608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:54:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:54:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:54:28 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:48 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:55:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:55:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:55:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238148608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:55:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:55:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Acquiring lock "cinder-4373e616-f91b-4891-aa6c-750892ae43b5-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.coordination [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Lock "cinder-4373e616-f91b-4891-aa6c-750892ae43b5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] remove_export for volume: 4373e616-f91b-4891-aa6c-750892ae43b5. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-821968297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4373e616-f91b-4891-aa6c-750892ae43b5,launched_at=2023-04-14T04:51:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10c8cf348e04e44afbaae93a4b60e36',provider_auth='CHAP mDOhFwYc 48M2NWlaEqdxt9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:51:13Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:55:51Z,updated_at=2023-04-14T04:55:51Z,use_quota=True,user_id='67d6c699fc524554a6f4983af91d58fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] detach volume v_4373e616-f91b-4891-aa6c-750892ae43b5 from target iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5/luns/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5/luns/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5/luns/v_4373e616-f91b-4891-aa6c-750892ae43b5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5/luns/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] failed to remove resource iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 because of JDSS resource v_4373e616-f91b-4891-aa6c-750892ae43b5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] delete target: iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] delete target iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] failed to remove resource iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 because of JDSS resource iqn.2010-10.org.openstack:4373e616-f91b-4891-aa6c-750892ae43b5 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] deleating volume v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] get snapshots for volume v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] get volume v_4373e616-f91b-4891-aa6c-750892ae43b5 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4373e616-f91b-4891-aa6c-750892ae43b5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449282', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116460', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14127695287113404483', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '283e8f38ba59833c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238148608', 'san:volume_id': '283e8f38ba59833c800263814d3552baf5a6bd73', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90690', 'name': 'v_4373e616-f91b-4891-aa6c-750892ae43b5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] delete volume:v_4373e616-f91b-4891-aa6c-750892ae43b5 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4373e616-f91b-4891-aa6c-750892ae43b5 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] volume v_4373e616-f91b-4891-aa6c-750892ae43b5 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:55:53 user cinder-volume[73393]: DEBUG cinder.quota [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Created reservations ['b0f2eefa-cfdd-40ce-a341-47625d353ba3', 'c92d8dc8-f0a3-4cb8-bddf-ee090e616c5e', 'ba8f05be-82c5-4c9c-9170-d24b2c1aad5d', '00894977-183a-48dd-9f89-d4fab5c53474'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:55:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:55:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:55:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238242816', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.manager [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:55:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Deleted volume successfully. Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-53df5c2a-0e41-445e-b065-11a5b28c11c5 tempest-AttachVolumeShelveTestJSON-2141578557 None] Lock "cinder-4373e616-f91b-4891-aa6c-750892ae43b5-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Acquiring lock "cinder-a8e6a311-8ecf-435d-a4bd-23726576f9bb-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Lock "cinder-a8e6a311-8ecf-435d-a4bd-23726576f9bb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] remove_export for volume: a8e6a311-8ecf-435d-a4bd-23726576f9bb. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2115435221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a8e6a311-8ecf-435d-a4bd-23726576f9bb,launched_at=2023-04-14T04:43:54Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10c8cf348e04e44afbaae93a4b60e36',provider_auth='CHAP ifwOWKGs 0tdsbnjORgmJ1Q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:43:52Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:55:54Z,updated_at=2023-04-14T04:55:54Z,use_quota=True,user_id='67d6c699fc524554a6f4983af91d58fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] detach volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb from target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb/luns/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] failed to remove resource iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb because of JDSS resource v_a8e6a311-8ecf-435d-a4bd-23726576f9bb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] delete target: iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] delete target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] failed to remove resource iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb because of JDSS resource iqn.2010-10.org.openstack:a8e6a311-8ecf-435d-a4bd-23726576f9bb DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] deleating volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] get snapshots for volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] get volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681448841', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116207', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5989900859163431976', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f6867d1fdcbf324e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238242816', 'san:volume_id': 'f6867d1fdcbf324e6f0f43e2b5baeb8a564b91ea', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '89329', 'name': 'v_a8e6a311-8ecf-435d-a4bd-23726576f9bb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] delete volume:v_a8e6a311-8ecf-435d-a4bd-23726576f9bb recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:55 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8e6a311-8ecf-435d-a4bd-23726576f9bb {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] volume v_a8e6a311-8ecf-435d-a4bd-23726576f9bb deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:55:56 user cinder-volume[73393]: DEBUG cinder.quota [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Created reservations ['05e533ee-b54c-454e-9bdd-5e90f097400f', '312aebaf-a056-455d-851f-aa324f30ecec', 'f9c02af1-8572-476d-b68d-4d2c5ba45fa4', '796b1047-86a1-4c3d-b97f-547d5000afdc'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:55:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:55:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:55:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:55:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:55:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238312448', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:55:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:55:57 user cinder-volume[73393]: DEBUG cinder.manager [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:55:57 user cinder-volume[73393]: INFO cinder.volume.manager [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Deleted volume successfully. Apr 14 04:55:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-dd742400-8e0f-4414-9ff0-9afb7ea0631e tempest-AttachVolumeShelveTestJSON-2141578557 None] Lock "cinder-a8e6a311-8ecf-435d-a4bd-23726576f9bb-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Flow 'volume_create_manager' (7f69ec44-7672-43ed-8518-4901ef13510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d68527c-14ca-4b31-9c67-116d2debe9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d68527c-14ca-4b31-9c67-116d2debe9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1743256580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='598efa797f02484d92b460673ddf0ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:03Z,use_quota=True,user_id='11e0b5056b5747f38743ce230e316a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a411959-28f7-4141-b5b6-4f2eb97af573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a411959-28f7-4141-b5b6-4f2eb97af573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27599baf-2c66-440d-8959-7811febcd432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27599baf-2c66-440d-8959-7811febcd432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'volume_name': 'volume-80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af8bc2e-5e15-4764-8a23-cab87915206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af8bc2e-5e15-4764-8a23-cab87915206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6991c622-b8a6-44f5-ae31-2033797ca25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:02 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'volume_size': 1} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] creating volume v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] create volume {'name': 'v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'is_clone': False, 'name': 'v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6991c622-b8a6-44f5-ae31-2033797ca25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de266a9f-4ab5-4750-9d07-845634d8e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:03 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Volume volume-80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 (80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754): created successfully Apr 14 04:56:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de266a9f-4ab5-4750-9d07-845634d8e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:03 user cinder-volume[73393]: DEBUG cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Flow 'volume_create_manager' (7f69ec44-7672-43ed-8518-4901ef13510d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:03 user cinder-volume[73393]: INFO cinder.volume.manager [req-d1352768-1a8e-4100-8205-ca4dd83b711e req-cc9a99a5-89a7-4071-a197-015ccc681bc5 tempest-VolumesGetTestJSON-1983539857 None] Created volume successfully. Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.coordination [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Acquiring lock "cinder-80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.coordination [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Lock "cinder-80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] remove_export for volume: 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1743256580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754,launched_at=2023-04-14T04:56:04Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='598efa797f02484d92b460673ddf0ac4',provider_auth='CHAP czhFYQdD Dh53MVrHEcueLo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:03Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:04Z,updated_at=2023-04-14T04:56:04Z,use_quota=True,user_id='11e0b5056b5747f38743ce230e316a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] detach volume v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 from target iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754/luns/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754/luns/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754/luns/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754/luns/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] failed to remove resource iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 because of JDSS resource v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] delete target: iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] delete target iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] failed to remove resource iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 because of JDSS resource iqn.2010-10.org.openstack:80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] deleating volume v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] get snapshots for volume v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] get volume v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449572', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116540', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11463830723366092496', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c6b34c8b1bacd247', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238242816', 'san:volume_id': 'c6b34c8b1bacd24723d39cf16b06bdc484afdb06', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90137', 'name': 'v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] delete volume:v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:04 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] volume v_80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:06 user cinder-volume[73393]: DEBUG cinder.quota [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Created reservations ['d4e2067f-242c-4f3a-bb7b-8d09268f7530', 'ce8eda3a-c54a-4854-a021-86bee64e1ab2', '88f2dc33-cb20-457e-9b74-8e86d09b4e29', '9499744b-8fd7-4641-a4bc-1d1a7c436cc3'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:06 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238312448', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:07 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:07 user cinder-volume[73393]: DEBUG cinder.manager [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:07 user cinder-volume[73393]: INFO cinder.volume.manager [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Deleted volume successfully. Apr 14 04:56:07 user cinder-volume[73393]: DEBUG cinder.coordination [req-02753637-3ef7-474f-9f5a-e37db8ea46c6 req-d9b4447b-13bc-4674-b376-ee2776b55570 tempest-VolumesGetTestJSON-1983539857 None] Lock "cinder-80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:08 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=45,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-aab44543-d2d5-4817-bbd7-9b132f13002f tempest-BackendsCapabilitiesAdminTestsJSON-887046710 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73393) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 04:56:09 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-66d35dbd-58d5-4b2f-b25b-c8fd23b5af3a tempest-BackendsCapabilitiesAdminTestsJSON-887046710 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73393) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Flow 'volume_create_manager' (e3670763-4eed-404c-a35a-b322e27fab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fb4e5b-88ac-4915-9e6a-a3cad0794eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fb4e5b-88ac-4915-9e6a-a3cad0794eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1449323029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a3bc215b-72e5-46b3-91cd-25e230bf7b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16969f216aa74a6091f5bd6e619b7f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:16Z,use_quota=True,user_id='c99912e8ab1c449b9f70d961610fc133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62a162-c1f5-46e5-af55-462a16d988f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62a162-c1f5-46e5-af55-462a16d988f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daac83b1-5dc2-4008-bf83-77deeae13203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daac83b1-5dc2-4008-bf83-77deeae13203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'volume_name': 'volume-a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1e3660-4586-40b3-8ed4-f6c4d14c922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1e3660-4586-40b3-8ed4-f6c4d14c922f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de96058-b078-4c83-8974-b30003a8702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:15 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Volume a3bc215b-72e5-46b3-91cd-25e230bf7b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'volume_size': 1} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] creating volume v_a3bc215b-72e5-46b3-91cd-25e230bf7b49. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] create volume {'name': 'v_a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:15 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:16 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'is_clone': False, 'name': 'v_a3bc215b-72e5-46b3-91cd-25e230bf7b49'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de96058-b078-4c83-8974-b30003a8702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5f0cd1-40f4-485f-a66d-e7271bf89e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:16 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Volume volume-a3bc215b-72e5-46b3-91cd-25e230bf7b49 (a3bc215b-72e5-46b3-91cd-25e230bf7b49): created successfully Apr 14 04:56:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5f0cd1-40f4-485f-a66d-e7271bf89e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:16 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Flow 'volume_create_manager' (e3670763-4eed-404c-a35a-b322e27fab87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:16 user cinder-volume[73393]: INFO cinder.volume.manager [None req-e5d2f101-375c-4be7-a3a3-f9cc436613c5 tempest-SnapshotMetadataTestJSON-249090085 None] Created volume successfully. Apr 14 04:56:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] create snapshot 09beeca6-a0af-4c0a-8775-3bf117f26c18 for volume a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 04:56:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] cloning v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 to s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 04:56:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] create snapshot s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 04:56:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:17 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_09beeca6-a0af-4c0a-8775-3bf117f26c18'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] create volume s_09beeca6-a0af-4c0a-8775-3bf117f26c18 from snapshot s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 04:56:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/clone {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:18 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49@s_09beeca6-a0af-4c0a-8775-3bf117f26c18', 'is_clone': True, 'full_name': 'Pool-0/s_09beeca6-a0af-4c0a-8775-3bf117f26c18', 'name': 's_09beeca6-a0af-4c0a-8775-3bf117f26c18'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/clone {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18/properties {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18/properties {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:20 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] volume s_09beeca6-a0af-4c0a-8775-3bf117f26c18 properties updated {{(pid=73393) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 04:56:20 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b5b76dad-60f1-4ffb-aafe-4ecc4d798de0 tempest-SnapshotMetadataTestJSON-249090085 None] Create snapshot completed successfully Apr 14 04:56:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Acquiring lock "cinder-09beeca6-a0af-4c0a-8775-3bf117f26c18-delete_snapshot" by "delete_snapshot" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:21 user cinder-volume[73393]: DEBUG cinder.coordination [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Lock "cinder-09beeca6-a0af-4c0a-8775-3bf117f26c18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] deleating snapshot s_09beeca6-a0af-4c0a-8775-3bf117f26c18. {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 04:56:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] get snapshots for volume s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:21 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] get volume s_09beeca6-a0af-4c0a-8775-3bf117f26c18 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49@s_09beeca6-a0af-4c0a-8775-3bf117f26c18', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_09beeca6-a0af-4c0a-8775-3bf117f26c18', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449587', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116553', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12317958380038757916', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2387f9ae27875c7f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238242816', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '90162', 'name': 's_09beeca6-a0af-4c0a-8775-3bf117f26c18', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] delete snapshot s_09beeca6-a0af-4c0a-8775-3bf117f26c18 of volume v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots/s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:22 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots/s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots/s_09beeca6-a0af-4c0a-8775-3bf117f26c18 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:23 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] snapshot s_09beeca6-a0af-4c0a-8775-3bf117f26c18 deleted {{(pid=73393) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 04:56:23 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=53,cinder:INSERT=8,cinder:UPDATE=31,cinder:DELETE=5 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:23 user cinder-volume[73393]: DEBUG cinder.quota [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Created reservations ['4ef4b680-858b-44ec-9326-dff7887689dc', 'dcb91ca8-1ec4-4a1f-874e-bd608bd67549', '5274e81d-93a3-431c-a535-6fec7e9d29ee', 'c0be7f69-8019-4844-a106-d74fac570b02'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:23 user cinder-volume[73393]: INFO cinder.volume.manager [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Delete snapshot completed successfully. Apr 14 04:56:23 user cinder-volume[73393]: DEBUG cinder.coordination [None req-64c5487e-9461-41c0-879d-857090806f02 tempest-SnapshotMetadataTestJSON-249090085 None] Lock "cinder-09beeca6-a0af-4c0a-8775-3bf117f26c18-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:24 user cinder-volume[73393]: DEBUG oslo_service.periodic_task [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73393) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 04:56:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:24 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Acquiring lock "cinder-a3bc215b-72e5-46b3-91cd-25e230bf7b49-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:24 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Lock "cinder-a3bc215b-72e5-46b3-91cd-25e230bf7b49-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] remove_export for volume: a3bc215b-72e5-46b3-91cd-25e230bf7b49. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1449323029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a3bc215b-72e5-46b3-91cd-25e230bf7b49,launched_at=2023-04-14T04:56:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16969f216aa74a6091f5bd6e619b7f16',provider_auth='CHAP lBrvQuDx xqvzdgsOwoN15p',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:16Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:25Z,updated_at=2023-04-14T04:56:25Z,use_quota=True,user_id='c99912e8ab1c449b9f70d961610fc133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] detach volume v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 from target iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49/luns/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49/luns/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49/luns/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49/luns/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] failed to remove resource iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 because of JDSS resource v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] delete target: iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] delete target iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] failed to remove resource iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 because of JDSS resource iqn.2010-10.org.openstack:a3bc215b-72e5-46b3-91cd-25e230bf7b49 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] deleating volume v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] get snapshots for volume v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Geting {'code': 200, 'error': None, 'data': {'available': '114238255104', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.manager [None req-9d4ac84d-07b6-470e-8ddf-185574ad689a None None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] get volume v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449584', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116547', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11072504709928822002', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e6301b8e3b2da599', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238255104', 'san:volume_id': 'e6301b8e3b2da599a84f98ed682d34db8c1de9c3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90149', 'name': 'v_a3bc215b-72e5-46b3-91cd-25e230bf7b49', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] delete volume:v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:25 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] volume v_a3bc215b-72e5-46b3-91cd-25e230bf7b49 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:27 user cinder-volume[73393]: DEBUG cinder.quota [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Created reservations ['4f0e7eb3-8808-482a-ade5-17287fca5287', '780340a7-f985-4023-8421-4be8511d2489', 'd24f721b-5752-4853-878a-4228fbf8d46e', '46be9dbc-2740-4ea6-b9e7-bfb16feb52b7'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:27 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238337024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:28 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:28 user cinder-volume[73393]: DEBUG cinder.manager [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:28 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Deleted volume successfully. Apr 14 04:56:28 user cinder-volume[73393]: DEBUG cinder.coordination [None req-6b7651f1-e434-44f6-8f23-9ba003de9a65 tempest-SnapshotMetadataTestJSON-249090085 None] Lock "cinder-a3bc215b-72e5-46b3-91cd-25e230bf7b49-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Flow 'volume_create_manager' (4fb32c87-7ef1-41bf-ac0e-7c60602a97d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0cc1da-8be8-4048-9785-fe16e945fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0cc1da-8be8-4048-9785-fe16e945fb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-348912546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3313b9f7-47ca-4eae-a5e9-182682d345ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e20f4deb5b4e50a89eb3df21a880df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:30Z,use_quota=True,user_id='b669235c93de4e03b0fb72f1a83632d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3bcbbb-15ab-4a82-9e82-b7ba2155bc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3bcbbb-15ab-4a82-9e82-b7ba2155bc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfc1600-e47d-4820-85a2-1b0820330db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfc1600-e47d-4820-85a2-1b0820330db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3313b9f7-47ca-4eae-a5e9-182682d345ba', 'volume_name': 'volume-3313b9f7-47ca-4eae-a5e9-182682d345ba', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebdbbe0-fd16-45e1-992e-5615500e9ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebdbbe0-fd16-45e1-992e-5615500e9ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb538dec-9f12-44ae-b0cf-5f05c8ff744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:30 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Volume 3313b9f7-47ca-4eae-a5e9-182682d345ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3313b9f7-47ca-4eae-a5e9-182682d345ba', 'volume_size': 1} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] creating volume v_3313b9f7-47ca-4eae-a5e9-182682d345ba. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] create volume {'name': 'v_3313b9f7-47ca-4eae-a5e9-182682d345ba', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:30 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:31 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3313b9f7-47ca-4eae-a5e9-182682d345ba', 'is_clone': False, 'name': 'v_3313b9f7-47ca-4eae-a5e9-182682d345ba'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb538dec-9f12-44ae-b0cf-5f05c8ff744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3313b9f7-47ca-4eae-a5e9-182682d345ba', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ab8213-dcef-48a0-a478-60dbec9cc253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:31 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Volume volume-3313b9f7-47ca-4eae-a5e9-182682d345ba (3313b9f7-47ca-4eae-a5e9-182682d345ba): created successfully Apr 14 04:56:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ab8213-dcef-48a0-a478-60dbec9cc253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:31 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Flow 'volume_create_manager' (4fb32c87-7ef1-41bf-ac0e-7c60602a97d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:31 user cinder-volume[73393]: INFO cinder.volume.manager [None req-270f3209-6a04-46f6-8d63-160cbbcfcddf tempest-VolumesMetadataTest-1246092559 None] Created volume successfully. Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Acquiring lock "cinder-3313b9f7-47ca-4eae-a5e9-182682d345ba-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Lock "cinder-3313b9f7-47ca-4eae-a5e9-182682d345ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] remove_export for volume: 3313b9f7-47ca-4eae-a5e9-182682d345ba. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-348912546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3313b9f7-47ca-4eae-a5e9-182682d345ba,launched_at=2023-04-14T04:56:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e20f4deb5b4e50a89eb3df21a880df',provider_auth='CHAP GTAizVXL YqFQUV1dNsDbkZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:30Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:33Z,updated_at=2023-04-14T04:56:33Z,use_quota=True,user_id='b669235c93de4e03b0fb72f1a83632d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] detach volume v_3313b9f7-47ca-4eae-a5e9-182682d345ba from target iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba/luns/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba/luns/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba/luns/v_3313b9f7-47ca-4eae-a5e9-182682d345ba'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba/luns/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] failed to remove resource iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba because of JDSS resource v_3313b9f7-47ca-4eae-a5e9-182682d345ba DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] delete target: iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] delete target iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] failed to remove resource iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba because of JDSS resource iqn.2010-10.org.openstack:3313b9f7-47ca-4eae-a5e9-182682d345ba DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] deleating volume v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] get snapshots for volume v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] get volume v_3313b9f7-47ca-4eae-a5e9-182682d345ba info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3313b9f7-47ca-4eae-a5e9-182682d345ba', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449599', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116562', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2075410528748502908', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '655f2ade82130575', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238255104', 'san:volume_id': '655f2ade82130575c57c643cb36e3f3bcf3a611b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88667', 'name': 'v_3313b9f7-47ca-4eae-a5e9-182682d345ba', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] delete volume:v_3313b9f7-47ca-4eae-a5e9-182682d345ba recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:33 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3313b9f7-47ca-4eae-a5e9-182682d345ba {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] volume v_3313b9f7-47ca-4eae-a5e9-182682d345ba deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:35 user cinder-volume[73393]: DEBUG cinder.quota [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Created reservations ['25cf14be-4f81-43bd-80a3-05490db5e674', 'a79d1156-6167-483a-95ae-a4529b6f01b0', '465d7451-143b-4645-9538-8d01255d71eb', '83759d81-b10f-46e8-876b-9aecbbf61aff'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:35 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238337024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:36 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:36 user cinder-volume[73393]: DEBUG cinder.manager [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:36 user cinder-volume[73393]: INFO cinder.volume.manager [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Deleted volume successfully. Apr 14 04:56:36 user cinder-volume[73393]: DEBUG cinder.coordination [None req-2e5a66a4-208a-4f06-8058-7329c04e4384 tempest-VolumesMetadataTest-1246092559 None] Lock "cinder-3313b9f7-47ca-4eae-a5e9-182682d345ba-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=53,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (33a44edf-c2af-422d-a3ab-571e01d83aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e94cb95-0ca6-4283-bc9f-194c9eb94c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e94cb95-0ca6-4283-bc9f-194c9eb94c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137665728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2f146b2d-2da0-443b-af1d-c07a4e4b5221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:39Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca00179d-59d6-462e-b254-e32258336ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca00179d-59d6-462e-b254-e32258336ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c890f596-6018-4203-9ebe-132cec8d77db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c890f596-6018-4203-9ebe-132cec8d77db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'volume_name': 'volume-2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74af952-c788-49eb-8fd9-30af4c8575c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74af952-c788-49eb-8fd9-30af4c8575c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d33a0b-77a3-462b-b78a-015ed60e4fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:38 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume 2f146b2d-2da0-443b-af1d-c07a4e4b5221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'volume_size': 1} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] creating volume v_2f146b2d-2da0-443b-af1d-c07a4e4b5221. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] create volume {'name': 'v_2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:38 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:39 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'is_clone': False, 'name': 'v_2f146b2d-2da0-443b-af1d-c07a4e4b5221'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d33a0b-77a3-462b-b78a-015ed60e4fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7321a0a7-13ee-4cb9-868c-5fcc48e8b694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:39 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume volume-2f146b2d-2da0-443b-af1d-c07a4e4b5221 (2f146b2d-2da0-443b-af1d-c07a4e4b5221): created successfully Apr 14 04:56:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7321a0a7-13ee-4cb9-868c-5fcc48e8b694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:39 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (33a44edf-c2af-422d-a3ab-571e01d83aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:39 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5ce91450-248d-42d6-af07-c355d34a8220 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created volume successfully. Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (09aa2e20-fbe3-4bdd-a71f-8ca2231dbf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebc1263-971e-486d-a048-eb33eed13a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebc1263-971e-486d-a048-eb33eed13a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1007142070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6f9091db-6b18-4842-acf9-80d4fe21dde0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:41Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eea2d3f-2097-4bd3-a1b1-ca053aa9c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eea2d3f-2097-4bd3-a1b1-ca053aa9c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29feba73-2ed1-4182-830f-23eb51ab23e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29feba73-2ed1-4182-830f-23eb51ab23e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9091db-6b18-4842-acf9-80d4fe21dde0', 'volume_name': 'volume-6f9091db-6b18-4842-acf9-80d4fe21dde0', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78a9c04-88c0-4e09-b24a-6a9009592e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78a9c04-88c0-4e09-b24a-6a9009592e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bade4e-7ecd-4ce7-850b-093b2cc3ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:40 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume 6f9091db-6b18-4842-acf9-80d4fe21dde0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9091db-6b18-4842-acf9-80d4fe21dde0', 'volume_size': 1} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] creating volume v_6f9091db-6b18-4842-acf9-80d4fe21dde0. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] create volume {'name': 'v_6f9091db-6b18-4842-acf9-80d4fe21dde0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:40 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (4518406f-95f7-41d4-9794-f4e17b65a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc6e937-36a1-454e-b7c3-56711358a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc6e937-36a1-454e-b7c3-56711358a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025414035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=003eef66-42c7-4736-b987-d29a7bc96586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:41Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c704a5-88da-465b-b815-fec102fb8386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c704a5-88da-465b-b815-fec102fb8386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a006e-44ce-48bc-9e40-96f45f26c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a006e-44ce-48bc-9e40-96f45f26c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003eef66-42c7-4736-b987-d29a7bc96586', 'volume_name': 'volume-003eef66-42c7-4736-b987-d29a7bc96586', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526a540e-822d-456d-a40d-64ff8e1b95f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526a540e-822d-456d-a40d-64ff8e1b95f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aaece4-2d55-4312-86ac-bebaff916090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume 003eef66-42c7-4736-b987-d29a7bc96586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003eef66-42c7-4736-b987-d29a7bc96586', 'volume_size': 1} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] creating volume v_003eef66-42c7-4736-b987-d29a7bc96586. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] create volume {'name': 'v_003eef66-42c7-4736-b987-d29a7bc96586', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (6b5f32c1-b10e-4060-b657-42810f09aaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d829d040-5c0a-47af-8294-825817fa4d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d829d040-5c0a-47af-8294-825817fa4d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240386893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=06595a75-efdd-4479-80b3-b49970ee4e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:41Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655d8ec5-f262-4ceb-8b13-0ba39fb7b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655d8ec5-f262-4ceb-8b13-0ba39fb7b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821111f5-1140-4fc1-8112-bcc8ebd29ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821111f5-1140-4fc1-8112-bcc8ebd29ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06595a75-efdd-4479-80b3-b49970ee4e65', 'volume_name': 'volume-06595a75-efdd-4479-80b3-b49970ee4e65', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926437cc-ddd1-4cb9-a870-f601a8ef3988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926437cc-ddd1-4cb9-a870-f601a8ef3988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d61913-ffad-449f-bfe2-0cdb64644d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume 06595a75-efdd-4479-80b3-b49970ee4e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06595a75-efdd-4479-80b3-b49970ee4e65', 'volume_size': 1} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] creating volume v_06595a75-efdd-4479-80b3-b49970ee4e65. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] create volume {'name': 'v_06595a75-efdd-4479-80b3-b49970ee4e65', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (c364ea3b-e414-462f-8948-914123e91f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ac834d-6145-4254-8252-f87d178e0083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ac834d-6145-4254-8252-f87d178e0083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-467487684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=912e5f87-4760-4a79-831a-c6c90a6e733b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:41Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fcc940-e37d-4a58-914e-36965e873793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fcc940-e37d-4a58-914e-36965e873793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593d6311-d808-4372-83b2-0fd0f1b3ef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593d6311-d808-4372-83b2-0fd0f1b3ef8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912e5f87-4760-4a79-831a-c6c90a6e733b', 'volume_name': 'volume-912e5f87-4760-4a79-831a-c6c90a6e733b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22f7ee-d6c5-4064-adc3-fc5586f5795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22f7ee-d6c5-4064-adc3-fc5586f5795e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed767826-2d0d-4e8b-b666-f0866545f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume 912e5f87-4760-4a79-831a-c6c90a6e733b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912e5f87-4760-4a79-831a-c6c90a6e733b', 'volume_size': 1} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] creating volume v_912e5f87-4760-4a79-831a-c6c90a6e733b. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] create volume {'name': 'v_912e5f87-4760-4a79-831a-c6c90a6e733b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73393) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (e7ac45ae-4ffa-4b83-a154-5dd80196654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36201db6-7db7-4b6f-b11e-d5f15c638675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36201db6-7db7-4b6f-b11e-d5f15c638675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-606955261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2afd11ab-fb3a-4426-b251-46fade996ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T04:56:42Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8)' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae91d40-0404-47e4-bd75-1b9e800ff513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae91d40-0404-47e4-bd75-1b9e800ff513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfda609f-71ad-434d-a22c-672a8f9e4ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfda609f-71ad-434d-a22c-672a8f9e4ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afd11ab-fb3a-4426-b251-46fade996ba3', 'volume_name': 'volume-2afd11ab-fb3a-4426-b251-46fade996ba3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b67f178-15ba-46b8-9dc4-cf7859c13b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b67f178-15ba-46b8-9dc4-cf7859c13b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53800010-0d62-4374-a2d3-87014c19cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:41 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume 2afd11ab-fb3a-4426-b251-46fade996ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afd11ab-fb3a-4426-b251-46fade996ba3', 'volume_size': 1} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] creating volume v_2afd11ab-fb3a-4426-b251-46fade996ba3. {{(pid=73393) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] create volume {'name': 'v_2afd11ab-fb3a-4426-b251-46fade996ba3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73393) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:41 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6f9091db-6b18-4842-acf9-80d4fe21dde0', 'is_clone': False, 'name': 'v_6f9091db-6b18-4842-acf9-80d4fe21dde0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bade4e-7ecd-4ce7-850b-093b2cc3ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9091db-6b18-4842-acf9-80d4fe21dde0', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907bda2a-70a6-4c53-9809-e115dcfcda2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=58,cinder:INSERT=7,cinder:UPDATE=34,cinder:DELETE=1 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume volume-6f9091db-6b18-4842-acf9-80d4fe21dde0 (6f9091db-6b18-4842-acf9-80d4fe21dde0): created successfully Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907bda2a-70a6-4c53-9809-e115dcfcda2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (09aa2e20-fbe3-4bdd-a71f-8ca2231dbf7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1f0bd4d0-20a0-4f29-a7d1-2ad5fc2621ce tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created volume successfully. Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_003eef66-42c7-4736-b987-d29a7bc96586', 'is_clone': False, 'name': 'v_003eef66-42c7-4736-b987-d29a7bc96586'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aaece4-2d55-4312-86ac-bebaff916090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003eef66-42c7-4736-b987-d29a7bc96586', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cd2e59-f97d-4c47-b6d8-78286f532f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume volume-003eef66-42c7-4736-b987-d29a7bc96586 (003eef66-42c7-4736-b987-d29a7bc96586): created successfully Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cd2e59-f97d-4c47-b6d8-78286f532f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (4518406f-95f7-41d4-9794-f4e17b65a881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f20f4bc4-cb67-486a-bde8-c7cfb578d1f3 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created volume successfully. Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_912e5f87-4760-4a79-831a-c6c90a6e733b', 'is_clone': False, 'name': 'v_912e5f87-4760-4a79-831a-c6c90a6e733b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed767826-2d0d-4e8b-b666-f0866545f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912e5f87-4760-4a79-831a-c6c90a6e733b', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dae2b2-f5d0-4909-b2db-2e063aec28df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume volume-912e5f87-4760-4a79-831a-c6c90a6e733b (912e5f87-4760-4a79-831a-c6c90a6e733b): created successfully Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dae2b2-f5d0-4909-b2db-2e063aec28df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (c364ea3b-e414-462f-8948-914123e91f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-f2c67f7c-2a03-4d5b-b42a-be7674a20697 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created volume successfully. Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_06595a75-efdd-4479-80b3-b49970ee4e65', 'is_clone': False, 'name': 'v_06595a75-efdd-4479-80b3-b49970ee4e65'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d61913-ffad-449f-bfe2-0cdb64644d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06595a75-efdd-4479-80b3-b49970ee4e65', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b912a42d-310c-4039-a2eb-c26539542c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2afd11ab-fb3a-4426-b251-46fade996ba3', 'is_clone': False, 'name': 'v_2afd11ab-fb3a-4426-b251-46fade996ba3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume volume-06595a75-efdd-4479-80b3-b49970ee4e65 (06595a75-efdd-4479-80b3-b49970ee4e65): created successfully Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b912a42d-310c-4039-a2eb-c26539542c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (6b5f32c1-b10e-4060-b657-42810f09aaaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53800010-0d62-4374-a2d3-87014c19cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afd11ab-fb3a-4426-b251-46fade996ba3', 'volume_size': 1}' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1868a2b-0d5b-4173-90ae-b102e92dbc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-b9b1b6eb-d398-476c-93a3-e21da7d300d7 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created volume successfully. Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.flows.manager.create_volume [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Volume volume-2afd11ab-fb3a-4426-b251-46fade996ba3 (2afd11ab-fb3a-4426-b251-46fade996ba3): created successfully Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1868a2b-0d5b-4173-90ae-b102e92dbc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73393) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 04:56:42 user cinder-volume[73393]: DEBUG cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Flow 'volume_create_manager' (e7ac45ae-4ffa-4b83-a154-5dd80196654b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73393) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 04:56:42 user cinder-volume[73393]: INFO cinder.volume.manager [None req-6f90501d-d6c5-4234-8416-42067e0db71e tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created volume successfully. Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Acquiring lock "cinder-2afd11ab-fb3a-4426-b251-46fade996ba3-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-2afd11ab-fb3a-4426-b251-46fade996ba3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove_export for volume: 2afd11ab-fb3a-4426-b251-46fade996ba3. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-606955261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2afd11ab-fb3a-4426-b251-46fade996ba3,launched_at=2023-04-14T04:56:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth='CHAP bJgpyVCz 80jSTAduW4ay6x',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:42Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:44Z,updated_at=2023-04-14T04:56:44Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume v_2afd11ab-fb3a-4426-b251-46fade996ba3 from target iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3/luns/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3/luns/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3/luns/v_2afd11ab-fb3a-4426-b251-46fade996ba3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3/luns/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 because of JDSS resource v_2afd11ab-fb3a-4426-b251-46fade996ba3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target: iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 because of JDSS resource iqn.2010-10.org.openstack:2afd11ab-fb3a-4426-b251-46fade996ba3 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] deleating volume v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get snapshots for volume v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get volume v_2afd11ab-fb3a-4426-b251-46fade996ba3 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2afd11ab-fb3a-4426-b251-46fade996ba3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449611', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116583', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16999544523862182787', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7dcc5d3a08fac44a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237857792', 'san:volume_id': '7dcc5d3a08fac44a99eca8c4145a0ba3f14e333e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90819', 'name': 'v_2afd11ab-fb3a-4426-b251-46fade996ba3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete volume:v_2afd11ab-fb3a-4426-b251-46fade996ba3 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:44 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2afd11ab-fb3a-4426-b251-46fade996ba3 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] volume v_2afd11ab-fb3a-4426-b251-46fade996ba3 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:46 user cinder-volume[73393]: DEBUG cinder.quota [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created reservations ['c337b718-e490-4c3d-ae09-aeb6612b354d', '0fc07f24-0255-40f7-bdae-56df466dcc3e', 'da6ab4b7-8738-4f73-b852-b27471e821cb', 'fa16e6af-335d-4caf-8399-840ee713ed4a'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:46 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'available': '114237939712', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.manager [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:47 user cinder-volume[73393]: INFO cinder.volume.manager [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Deleted volume successfully. Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-1df9fb86-a731-4bae-a898-ce667f6811a2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-2afd11ab-fb3a-4426-b251-46fade996ba3-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Acquiring lock "cinder-912e5f87-4760-4a79-831a-c6c90a6e733b-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-912e5f87-4760-4a79-831a-c6c90a6e733b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove_export for volume: 912e5f87-4760-4a79-831a-c6c90a6e733b. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-467487684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=912e5f87-4760-4a79-831a-c6c90a6e733b,launched_at=2023-04-14T04:56:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth='CHAP IlKjSviU zG0vblHcyYO1us',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:47Z,updated_at=2023-04-14T04:56:47Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume v_912e5f87-4760-4a79-831a-c6c90a6e733b from target iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b/luns/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b/luns/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b/luns/v_912e5f87-4760-4a79-831a-c6c90a6e733b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b/luns/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b because of JDSS resource v_912e5f87-4760-4a79-831a-c6c90a6e733b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target: iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b because of JDSS resource iqn.2010-10.org.openstack:912e5f87-4760-4a79-831a-c6c90a6e733b DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] deleating volume v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get snapshots for volume v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:47 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get volume v_912e5f87-4760-4a79-831a-c6c90a6e733b info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_912e5f87-4760-4a79-831a-c6c90a6e733b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449610', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116578', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11093838463998613283', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '838f5639e34e7f1a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114237939712', 'san:volume_id': '838f5639e34e7f1a513f59ac7a118e0c86c5225b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88691', 'name': 'v_912e5f87-4760-4a79-831a-c6c90a6e733b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete volume:v_912e5f87-4760-4a79-831a-c6c90a6e733b recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:48 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_912e5f87-4760-4a79-831a-c6c90a6e733b {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] volume v_912e5f87-4760-4a79-831a-c6c90a6e733b deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:49 user cinder-volume[73393]: DEBUG cinder.quota [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created reservations ['0b2ac9fd-f4c8-4d30-a42c-86c3ef3847aa', '766a08cf-722d-439b-9d6f-62c3194a54b2', '37f65592-0b7c-4ca2-b1d6-7337957d0a8a', '4100ac7b-f1b8-4247-bbd0-3c838da5a200'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:49 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238021632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.manager [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:50 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Deleted volume successfully. Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9a963b1e-0032-4d2c-b605-86b5761f582a tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-912e5f87-4760-4a79-831a-c6c90a6e733b-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Acquiring lock "cinder-06595a75-efdd-4479-80b3-b49970ee4e65-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.coordination [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-06595a75-efdd-4479-80b3-b49970ee4e65-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove_export for volume: 06595a75-efdd-4479-80b3-b49970ee4e65. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240386893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=06595a75-efdd-4479-80b3-b49970ee4e65,launched_at=2023-04-14T04:56:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth='CHAP afWwXHxZ Nl5yktoZfJA6cH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:51Z,updated_at=2023-04-14T04:56:51Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume v_06595a75-efdd-4479-80b3-b49970ee4e65 from target iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65/luns/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65/luns/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65/luns/v_06595a75-efdd-4479-80b3-b49970ee4e65'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65/luns/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 because of JDSS resource v_06595a75-efdd-4479-80b3-b49970ee4e65 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target: iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 because of JDSS resource iqn.2010-10.org.openstack:06595a75-efdd-4479-80b3-b49970ee4e65 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] deleating volume v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get snapshots for volume v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:50 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get volume v_06595a75-efdd-4479-80b3-b49970ee4e65 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_06595a75-efdd-4479-80b3-b49970ee4e65', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449610', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116577', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10922795824445931942', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '20ed518db97729b8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238021632', 'san:volume_id': '20ed518db97729b845472845fb2437343b54d64e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88684', 'name': 'v_06595a75-efdd-4479-80b3-b49970ee4e65', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete volume:v_06595a75-efdd-4479-80b3-b49970ee4e65 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:51 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06595a75-efdd-4479-80b3-b49970ee4e65 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] volume v_06595a75-efdd-4479-80b3-b49970ee4e65 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=60,cinder:UPDATE=26,cinder:DELETE=7,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.quota [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created reservations ['25b34024-9473-4631-8656-424d728dd9f2', '72637ab5-4cc9-48a3-9cb9-be14a00284b2', '9895cda2-1546-4a08-8875-74a76fefca89', '31f467c1-e25e-44be-9520-5bd4b27c1e65'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Acquiring lock "cinder-003eef66-42c7-4736-b987-d29a7bc96586-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-003eef66-42c7-4736-b987-d29a7bc96586-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove_export for volume: 003eef66-42c7-4736-b987-d29a7bc96586. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025414035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=003eef66-42c7-4736-b987-d29a7bc96586,launched_at=2023-04-14T04:56:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth='CHAP vFcWOPjX 8lo4LbUYaQI5GA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:54Z,updated_at=2023-04-14T04:56:54Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume v_003eef66-42c7-4736-b987-d29a7bc96586 from target iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586/luns/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586/luns/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586/luns/v_003eef66-42c7-4736-b987-d29a7bc96586'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586/luns/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 because of JDSS resource v_003eef66-42c7-4736-b987-d29a7bc96586 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target: iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 because of JDSS resource iqn.2010-10.org.openstack:003eef66-42c7-4736-b987-d29a7bc96586 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] deleating volume v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get snapshots for volume v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:53 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238103552', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.manager [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:54 user cinder-volume[73393]: INFO cinder.volume.manager [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Deleted volume successfully. Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.coordination [None req-904fbf70-ae9c-48dc-a276-15326fa26d73 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-06595a75-efdd-4479-80b3-b49970ee4e65-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get volume v_003eef66-42c7-4736-b987-d29a7bc96586 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_003eef66-42c7-4736-b987-d29a7bc96586', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449610', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116574', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13481483947974829697', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '824ab4c27b96b3e0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238103552', 'san:volume_id': '824ab4c27b96b3e07bd33f34c2f5e391d8c225b4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '88676', 'name': 'v_003eef66-42c7-4736-b987-d29a7bc96586', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete volume:v_003eef66-42c7-4736-b987-d29a7bc96586 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:54 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_003eef66-42c7-4736-b987-d29a7bc96586 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] volume v_003eef66-42c7-4736-b987-d29a7bc96586 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.quota [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created reservations ['6fcf64cd-eb20-472f-8252-1e5d31cd2e0e', '80fc811c-6223-4850-9043-f52367c6e42d', '8b7f927d-4c1c-489f-9655-94186c0c8a4b', '8765dc34-2f40-4461-92ec-c646c74e3d10'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:SELECT=57,cinder:UPDATE=36,cinder:INSERT=7 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238185472', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.manager [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:56:56 user cinder-volume[73393]: INFO cinder.volume.manager [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Deleted volume successfully. Apr 14 04:56:56 user cinder-volume[73393]: DEBUG cinder.coordination [None req-9da9a3ff-2ad2-434f-a0b0-497819fcf397 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-003eef66-42c7-4736-b987-d29a7bc96586-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Acquiring lock "cinder-6f9091db-6b18-4842-acf9-80d4fe21dde0-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-6f9091db-6b18-4842-acf9-80d4fe21dde0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove_export for volume: 6f9091db-6b18-4842-acf9-80d4fe21dde0. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1007142070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6f9091db-6b18-4842-acf9-80d4fe21dde0,launched_at=2023-04-14T04:56:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth='CHAP QaYZzhMd k4HxotEYvbwTW7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:41Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:56:57Z,updated_at=2023-04-14T04:56:57Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume v_6f9091db-6b18-4842-acf9-80d4fe21dde0 from target iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0/luns/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0/luns/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0/luns/v_6f9091db-6b18-4842-acf9-80d4fe21dde0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0/luns/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 because of JDSS resource v_6f9091db-6b18-4842-acf9-80d4fe21dde0 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target: iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 because of JDSS resource iqn.2010-10.org.openstack:6f9091db-6b18-4842-acf9-80d4fe21dde0 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] deleating volume v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get snapshots for volume v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get volume v_6f9091db-6b18-4842-acf9-80d4fe21dde0 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6f9091db-6b18-4842-acf9-80d4fe21dde0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449610', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116571', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13660315629203234559', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6ea2a0b5a6a227a6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238185472', 'san:volume_id': '6ea2a0b5a6a227a6536e538ac87ae392d8d835b5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90186', 'name': 'v_6f9091db-6b18-4842-acf9-80d4fe21dde0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete volume:v_6f9091db-6b18-4842-acf9-80d4fe21dde0 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:57 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:56:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6f9091db-6b18-4842-acf9-80d4fe21dde0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:56:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] volume v_6f9091db-6b18-4842-acf9-80d4fe21dde0 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:56:59 user cinder-volume[73393]: DEBUG cinder.quota [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created reservations ['c0569da6-d01f-4123-a7ea-56d2744679d2', '6e71472f-7238-4e6e-957c-e57aeddc9d8d', '9c72ab3f-8d4a-4f3a-8af5-3a7ed6d3e5d6', 'f32c6586-641b-4c13-ac31-150cfb000dc9'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:56:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:56:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:56:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:56:59 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238267392', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.manager [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:57:00 user cinder-volume[73393]: INFO cinder.volume.manager [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Deleted volume successfully. Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-5dd1bfde-fc45-4ca1-b719-d5bc60886b72 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-6f9091db-6b18-4842-acf9-80d4fe21dde0-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Acquiring lock "cinder-2f146b2d-2da0-443b-af1d-c07a4e4b5221-delete_volume" by "delete_volume" {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.coordination [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-2f146b2d-2da0-443b-af1d-c07a4e4b5221-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove_export for volume: 2f146b2d-2da0-443b-af1d-c07a4e4b5221. {{(pid=73393) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] remove export {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T04:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137665728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2f146b2d-2da0-443b-af1d-c07a4e4b5221,launched_at=2023-04-14T04:56:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0a8ff730bb4e5699417edc2dfacf2b',provider_auth='CHAP XrMCvBNH a6cEFs82Z9rnhY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T04:56:39Z,service_uuid='dca09de7-eab3-4113-b2e5-b9bc01ede4bc',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T04:57:00Z,updated_at=2023-04-14T04:57:00Z,use_quota=True,user_id='e14d60153c784ab6acbf21c260592528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae56b00-efa6-4456-b946-b0b57e8616a8),volume_type_id=aae56b00-efa6-4456-b946-b0b57e8616a8) from target:iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] detach volume v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 from target iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221/luns/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221/luns/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221/luns/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221/luns/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 because of JDSS resource v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target: iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete target iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] failed to remove resource iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 because of JDSS resource iqn.2010-10.org.openstack:2f146b2d-2da0-443b-af1d-c07a4e4b5221 DNE. {{(pid=73393) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] deleating volume v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get snapshots for volume v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221/snapshots {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221/snapshots {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] get volume v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 info {{(pid=73393) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:57:00 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:57:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681449607', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '116567', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5090498391956671980', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cb411d02e5d563b1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114238267392', 'san:volume_id': 'cb411d02e5d563b121e9ab8add1b0b177b19ac5f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '90177', 'name': 'v_2f146b2d-2da0-443b-af1d-c07a4e4b5221', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:57:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] delete volume:v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 recursively children:{'force_umount': True} {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 04:57:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:57:01 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:57:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:57:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] volume v_2f146b2d-2da0-443b-af1d-c07a4e4b5221 deleted {{(pid=73393) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 04:57:02 user cinder-volume[73393]: DEBUG cinder.quota [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Created reservations ['9f10abbd-6447-483d-94bd-aa20b387844b', 'dc57e461-dc1f-4b95-8155-4ebef1a5df38', '6cba4a45-7f19-46d0-bd83-25109b53e0b8', 'c2dd0603-6354-41fe-bb3f-987b01e6b883'] {{(pid=73393) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 04:57:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Updating volume stats {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 04:57:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Get pool Pool-0 fsprops {{(pid=73393) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 04:57:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 04:57:02 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 04:57:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Geting {'code': 200, 'error': None, 'data': {'available': '114238349312', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73393) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 04:57:03 user cinder-volume[73393]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Total capacity: 119, Free 106. {{(pid=73393) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 04:57:03 user cinder-volume[73393]: DEBUG cinder.manager [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Notifying Schedulers of capabilities ... {{(pid=73393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 04:57:03 user cinder-volume[73393]: INFO cinder.volume.manager [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Deleted volume successfully. Apr 14 04:57:03 user cinder-volume[73393]: DEBUG cinder.coordination [None req-05f9311f-8a15-453c-8bdc-d14bc97f85d2 tempest-CreateVolumesFromSourceVolumeTest-305684625 None] Lock "cinder-2f146b2d-2da0-443b-af1d-c07a4e4b5221-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=73393) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 04:57:18 user cinder-volume[73393]: DEBUG dbcounter [-] [73393] Writing DB stats cinder:UPDATE=18,cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=3 {{(pid=73393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}